Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,153,017 members, 7,818,009 topics. Date: Sunday, 05 May 2024 at 03:46 AM

Felixitie's Posts

Nairaland Forum / Felixitie's Profile / Felixitie's Posts

(1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (of 16 pages)

Programming / Re: Analysis Of The Nairaland's Front Page Topics, Using Python And Tableau by Felixitie(m): 10:31pm On Sep 24, 2022
BB Naijaaaaaa.....BBNaija Live Updates is the most viewed topic..wow. with over one million views.. so people actually follow this program!!! No doubt

2 Likes

Programming / Re: Analysis Of The Nairaland's Front Page Topics, Using Python And Tableau by Felixitie(m): 10:02pm On Sep 24, 2022
Top 10 posters.

1 Like

Programming / Re: Analysis Of The Nairaland's Front Page Topics, Using Python And Tableau by Felixitie(m): 9:50pm On Sep 24, 2022
Politics section always on number one and why? Election Period or a kind of online campaign

2 Likes 1 Share

Programming / Analysis Of The Nairaland's Front Page Topics, Using Python And Tableau by Felixitie(m): 9:47pm On Sep 24, 2022
Sometimes, it feels good playing with real life data and getting insights from them.

The data used for this analysis was extracted from Nairaland using Webscraping (HTMLSession and Bs4)

The cleaning of the data was done using python Pandas.

The visualization part was done using Tableau.

And these questions are to be answered!

Number of topics scraped =1344 Topics (From today, 24th September)

Which topic got the Highest views? And what time of the day it was posted?

Which Topic also got the  lowest views?

Can we get the Top 10 Topic with highest views from the 1344 topics posted in the last few days or weeks

Section with most topics?

Who posted most topic? And the who were the top ten posters.

When were these Topics posted? what time of the day?
Etc.

Here, we go!

5 Likes 2 Shares

Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 6:37pm On Jul 31, 2022
Wande22:
still Awaiting your responses

Have you covered the data analysis part of Excel? Inclusive of power query and pivot tables/charts.
Then Learn SQL for now and maybe one of PowerBI or Tableau next , then you could go further to python.
VBA is now old school.
Good luck my brother.
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 6:37pm On Jul 31, 2022
Wande22:
still Awaiting your responses

.
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 9:23pm On Jul 28, 2022
IamBabsjnr:

thank you.
erm,pls how do i clean data with excel?
The likes of excel formula and functions
Power Query (so powerful)
Check Excelisfun on YouTube, and focus on the data analysis part of his video
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 8:52pm On Jul 28, 2022
IamBabsjnr:
Even though i have no prior knowledge on excel,i played with it and i got this.
.
.
the table is from a flier i was given on the street.its a school WAEC performance.
.
.
.
what do you guys think?
.
.
.
am almost done with learning python basics,hoping to dive into SQL soon.


Good one. However, you need to understand how to structure data by doing some data cleaning and restructuring so as to make it more meaningful and insightful to the eye and brain.

Also, pie chart isn't the idea chart type for the above demo project.
I wish you good luck bro.
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 8:46pm On Jul 28, 2022
Kaycee54321:
So guys...

I dumped a lot of engagements to free myself today for a technical interview for a foreign firm and less than two hours to the interview, got a mail from the VP cancelling the process because "something came up"...

Why am I sharing this?

Just to let y'all know that
Hiring data guys from Nigeria = A Politician sharing his deepest secrets with a Gossip
...in the eyes of Europeans/Americans.

Be informed.


Yeah, it is what it is.. In this field, those foreign recruiters or coys find it hard trusting guys from this part of the world with their data.,one of the challenges! But That will not make us quit.
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 10:55pm On Jun 19, 2022
Ehido:
Goodday all,

Please I would like someone to recommend a good and free desktop SQL software that does not require internet connection.

Internet subscription is costing me a lot of money, hence its hard to keep practicing on bigquerry.

I need to be able to download practice data sets from kaggle or any other site and work on it offline. Thank you very much for your suggestions.

Why not install MYSQL or SQLSERVER MS and practice offline using dataset you get from kaggle or any other source, you can import the csv or excel file into the mysql or ssms for further practice.

2 Likes 1 Share

Health / Re: Trying To Conceive A Child? TTC by Felixitie(m): 4:53pm On Jun 13, 2022
Ufemia26:


Thanks for your response.
Please I would really love to connect with you on WhatsApp if you don't mind.
Health / Re: Trying To Conceive A Child? TTC by Felixitie(m): 9:41pm On Jun 12, 2022
Ufemia26:


Please Mamas in the house, I need help.

Hello, you know what? The Hsg could not give a conclusive report about your tubes hence the reason for further investigation via laparascopy or hystero.,but it seems uterine adhesion hindered the dyes from going through to the tubes. Laparascopy isn't invasive surgery, they use the method to confirm tube status., it is more concise than hsg. Read more on it on Internet.

Above all, keep calm. I believe your tubes are fine. Cheers

1 Like

Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 2:22pm On May 23, 2022
idmicheal20:
Good morning,

Can anyone please suggest away I can download udemy or coursera video directly to my gallery?

I have checked it on google and follow the process listed but it is not working.

Have you tried using udeler? I have used it sometimes back. Google it and check on how to use it.
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 10:53pm On May 20, 2022
absool:
Hello guys.

Please which is better and mostly in the industry amongst; Power BI, Tableau and Excel?

All...is a relative to the company you working for., different coy with different tools. I believe Excel knowledge is essential though.
Aside these tools mentioned, we still have some other ones utilised by different companies. E plenty!
Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 3:31pm On Apr 29, 2022
idmicheal20:
Good morning everyone.

I'm having issues with my MY SQL

The COUNT, MIN AND MAX seems not to be working. Bosses in the house please what should I do?

Remove the comma sign before the from statement, also try using underscore to link your string or aliases together instead of using space

1 Like

Programming / Re: Chronicle Of A Data Scientist/analyst by Felixitie(m): 11:41am On Apr 01, 2022
Omotaday:
Through this thread, I was motivated to start learning excel and Sql (through youtube and web materials), I can say I can comfortable use both to some extent. Hoping to be good in those before moving to Tableau and then Python. However, I am having issue on how I can start to put what I've learnt into use.

For Instance, I've got Data files on Airline performance from 1987 to 2008, I am to analyze and treat this data, they are about for 22 files with each having over 1 million rows of record. I'm not sure if I should import these files through Excel -Data- Query, merge them(this may be too large for excel) and try to make sense out of it, or I need to find a way to get the files into PostgreSQL. I will appreciate comments on the process to treat a data like this or how to start with it.

Lastly, I am looking for a mentor or coach, someone who is already in the field, I don't mind discussing terms. Things are easier for me when I have access to someone I can ask this questions whenever I'm stuck.

Thanks wink

Excel Power pivot should handle that or powerbi. If the files are in csv you could import them into sql server or mysql.

2 Likes

Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 8:24pm On Mar 11, 2022
Jaguarspaw:
You sure nairaland allow scrapping without permision?
Check it out.
www.nairaland.com/robots.txt

Here is the script for todays front page topics ( the first 5 pages )

1 Like

Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 7:42pm On Mar 11, 2022
Jaguarspaw:
You sure nairaland allow scrapping without permision?
Check it out.
www.nairaland.com/robots.txt

Did you try to scrape it? Well, I could give you the script and run it... We dey scrape a more sophisticated site... And u think NL is hard to scrape.. Lol
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 9:28pm On Mar 08, 2022
Anon4:
do you run it on cloud or locally

On my local machine!
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 10:00pm On Mar 06, 2022
mustyx001:



Nice one. Just curious, can request and beautifulsoup bypass Amazon's anti-scraping mechanism.

Scraping Nairaland with php also went smoothly since they didn't prevent scraping.


Selenium works, then pass it to beautifulsoup
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 8:55pm On Mar 06, 2022
Gentleman001:
Kudos brother..

Checking the url of each topic, I noticed they fellow different pattern( unlike some web where you can easily loop through multiple pages with range of page numbers to perform the scraping )...

My question is, do you manually copied all the url link you scraped or there is a way you go about it?

This is how it works, with beautifulsoup.
You get or scrap the link for all the topics you need in form of a list and have it assigned a variable, then you loop through each of them. Those links have the same html setup or tags..
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 11:10pm On Mar 05, 2022
airsaylongcome:


December 2021 to January 2022 would be interesting. Just to see the percentage difference in Programming Section thread that had hit FP.

I'm a data lover and with the data you have to many thoughts have come to my head. Which section noticed a decline in threads hitting FP?

Definitely I should be able to come up with that information. I will extend my scraping to December. Obviously we have a lot of insights to derive from the dataset.. but for what purpose actually? NL no send me message.. Lol

1 Like

Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 9:47pm On Mar 05, 2022
airsaylongcome:


What percentage of FP topics were from Programming sub? Programming threads have started hitting fp now a bit more than before. Cam you extend your data harvesting to see percentage increase of Programming threads?

Yes sure I can,apparently it is a nice insight to look at. BTW,do u mean percentage difference in month on month? And from which month specifically do u want me to look at ? Jan - February or December - January etc. I hope you understand!
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 3:14pm On Mar 05, 2022
Chuukwudi:


Nice.
If the op Felixitie would let me have the csv file, I might be able to predict the most likely section subsequent front page topics will emerge from.

This can Infact be used to score the admins of all the sections and classify them in a way that reflects what section Nairalanders are most interested in, the job of the mods, etc.


I am sure I will find high correlation between snake threads and lalasticlala.

I wonder if I've got time for that. But it would be a nice idea for anyone trying to learn some Machine Learning. grin

This idea is cool bro, if you are still willing to have the csv file and work on it, I can forward it to you. Machine Learning no be beans ooo..
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 3:12pm On Mar 05, 2022
Chuukwudi:
How did you get the data? Does nairaland have an API or you manually read the lines and reg expressions to get dates and all?

Web scraping bro, with Request & Beautifulsoup..
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 12:33am On Mar 05, 2022
LikeAking:
Oga u too much. NL should just employ you.

Nice!

You are finishing werk.


LOL. We are just trying to cruise with the little skills we learn. Thanks boss man.

1 Like 1 Share

Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 2:26pm On Mar 04, 2022
Felixitie:
To further the analysis, I want to see the sections that produces top most topics on the front page for the current month of March This should give us the section that interest members most or the ones the NL management wants people to see. Based on the last 10 front page topics ( March 4th, today to the last 10 pages.


It is obvious that the political section got highest topic moved to the front page..

Even the programming section is missing, is it that people aren't interested in programming or IT related field?

1 Like

Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 9:16am On Mar 04, 2022
At least 60% of those topics were posted between Monday to Thursday of the week. You still have some 40% of the topics left to grab over the weekend if you were busy going through the mid-week topics lol

Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 11:31pm On Mar 03, 2022
Samboizz:
Nice one bro. I would like to get in contact with you

Responded to your pm!
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 11:20pm On Mar 03, 2022
Enskynelson:
Nice one. Would like to follow your work. Please check your DM.

OKAY SeniorMan
Programming / Re: Nairaland's February Front Page Data Analysis by Felixitie(m): 11:13pm On Mar 03, 2022
To further the analysis, I want to see the sections that produces top most topics on the front page for the current month of March This should give us the section that interest members most or the ones the NL management wants people to see. Based on the last 10 front page topics ( March 4th, today to the last 10 pages.

2 Likes 3 Shares

Programming / Nairaland's February Front Page Data Analysis by Felixitie(m): 9:57pm On Mar 03, 2022
Yeah,I was trying to check my proficiency in data analysis, I decided to use the first 10 pages on Nairaland front page topics.

Web scraping( selemium, Bs4 , HTMLsession, Scrapy) , Python Pandas, PowerBI , Excel, SQL

I Web scraped the data using python Beautifulsoup (Bs4). This was done by getting all the front page topic links, lopped through each one of them to get ; the title of the topic, poster of the topic, time and date it was posted.

The output was then saved in csv file format.

I could have cleaned the raw data using python Pandas, but I prefer to used powerbi since I planned using it to create a simple dashboard for the analysis. Therefore PowerBI was used for visualization.

More of descriptive analysis for the month of February ;

Who posted most topic?
Time of the with most topic?
How does the Daily Topic trends look?

6 Likes 8 Shares

(1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (of 16 pages)

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 64
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.