Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 10:09am On Oct 13, 2020 |
GreenDee: Yeah.. Exactly..Its good for a start, especially for ppl that are new to the field, and it's even free so you have nothing to lose,just only to invest your time and data. No, it's not free. The fee is $80 |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 9:28am On Oct 13, 2020 |
Dahyormine: Yes it's not too relevant if you are looking for a job at google or amazon, but it is a plus to your cv as far as naija job is concerned, if you can easily afford it, it's worth it. I'm also considering having it, at least for a start.
Note, IBM data science certification still stands out among others. That's nice! Do you know any relevant Data Analytics certification(s) |
|
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 10:21am On Oct 10, 2020 |
|
|
Travel › Re: General-german-student-visa-enquiries Part 8 by BelieverDE: 3:31am On Oct 08, 2020*. Modified: 4:01am On Oct 08, 2020 |
IOladiplenty: I am still waiting for you to get back to me on Barmer health insurance for enrolment. Thanks in advance. I have sent you an e-mail. |
Travel › Re: General-german-student-visa-enquiries Part 8 by BelieverDE: 3:08pm On Oct 07, 2020 |
smokers: Please for those doing online semester. How did you complete enrollment. Especially the health insurance part. Barmer is your best option. They are in partnership with Nigerian Scholars in Germany (NiSIG) |
|
Travel › Re: General-german-student-visa-enquiries Part 8 by BelieverDE: 10:57am On Oct 04, 2020 |
chi555: www.nisig.de/summit
The Nigerian Scholars in Germany are having their annual summit and its online for the first time due to the CoVID situation. If you are interested to meet and network with scholars already in germany, u could register for the event. Its a full day event with topics such as Job application in Germany, doing a PhD in Germany etc. Check it out via the link above. Thanks for sharing link. I really enjoyed yesterday's sessions. |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 10:32pm On Sep 30, 2020 |
ibromodzi: That's the power of research. The more you read, the more information you have at your disposal.
Visual inspection of data distribution (histogram, box plot, q-q plot, p-p plot) is informal, unreliable and does not guarantee that the distribution is normal. Nevertheless, presenting your data visually gives your audience the ability to judge the distribution themselves.
There are many formal tests that can be used for normality aside Shapiro Wilk and K-S tests. However, the former is recommended by many researchers regardless of the sample size, owing to the fact that K-S test is sensitive to extreme values.
You can read more about Normality test here https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3693611/
@ the emboldened. I'm a final year student of optometry and vision science. No statistics/math. Although, I took some basic math/stat/CS courses in 100/200L I like you, brother!  I suppose I'll have to focus more on the Shapiro Wilk test. There's no need exploring the K-S test when it's sensitive to extreme values. I could many rows of data and I wouldn't want to be scared that extreme anomalous values can affect my result. Thanks a lot, brother. Cheers! |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 7:56pm On Sep 30, 2020 |
ibromodzi: While skewness and kurtosis are supported for testing normality by some texts, the most acceptable standard is by using a formal test (i.e Shapiro Wilk's test) or visually by using q-q/p-p plots. That being said, an alternative, non parametric test for a paired T test will be Wilcoxon paired signed rank test . My God!!!! When will I finish learning everything?! I read this post in the morning and decided to make more research before asking for more clarity, but I became confused the more. Different people on researchgate were proffering different answers on the best normality test. Some said when we have a sample size that is less than 50, we should use the Shapiro Wilk's test; and if the sample size is greater than 50 we should use the Kolmogorov-Smirnov test. Then different researchers began talking about sensitivity of the two tests to confuse me the more. To me, if the population is greater than 50, why perform another test when you know the population would be normal (thanks to the Central Limit Theorem) ? About two researchers went basic and talked about the use of histogram. I've got no time for that, and would rather use the test for skewness and kurtosis instead. You must come from a Statistics/Mathematics background, what course would you suggest for me if I want to perform a two paired T test? If the sample size is above 100, would you still use the Shapiro Wilk test? If no, why? |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 8:16pm On Sep 29, 2020 |
ibromodzi: I'm glad you were able to pick some things from it. Frankly speaking, I asked myself if I wasn't typing rubbish while trying to come up with a simple, yet wordy answer to the question.
Pertaining to your question, yes your answers are correct to some extent. I like the way you think.
In the first example, the clinical trial will most likely involve testing the new drug against a placebo on the same set of patients, in which case a paired T test (or alternative non parametric tests if assumptions of normality and homogeneity of variance are not satisfied).
The second example is a predictive analytics and that's where ML comes in - Logistic Regression is a good algorithm to start with. Thanks, I'm glad I am on the right track. Let's assume the population of a T test, after checking for kurtosis and skewness, is not normal. What alternative test do you think can be carried out for hypothesis testing? |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 8:24am On Sep 29, 2020 |
ibromodzi: From your write up, I can deduce that two things are missing in your data analytics armament. First is the theoretical knowledge of data analysis (most guys joke with this always) and the second one is the domain knowledge needed to navigate through any data you are working on. You can't make any meaningful conclusion about datasets without these two.
Now, back to the question. Honestly, a simple google search would have given you the answers to your questions, but I'll still try to break it down according to my own little understanding of data science.
Any data collected in its raw form has no meaning until it is processed according to what the company requires so as to utilize the data solely for decision making purpose (making conclusion), which in turn helps the company to grow. Now, there are two important things here, 1. The company's requirement (i.e why was the data collected in the first place?) - Let me give you a couple of real life examples here:
a. The government wants to know whether a newly developed drug will be effective in the treatment of Covid-19. So they do this by conducting a round of clinical trials on patients willing to participate. Remember why the clinical trials were conducted? To test the effectiveness of the drug. b. A financial institution (bank for instance) wants to develop an advanced system for detecting fraudulent transactions among their customers. They do this by getting a large record of transactions that have taken place in the past. Again, you remember why they needed the record of past transactions? I hope you are getting the gist by now?
2. Now, let's continue with the second important thing in data analysis process which is the goal/objective of obtaining the data in the first place - to make decisions or conclusion about the data.
Going back to the examples I gave above, the government can conclude whether or not the drug is effective based on the outcome of the clinical trial, the financial institution can spot fraudulent transactions based on the model built with the data collected, a country can project their future population based on the available data and make appropriate policies to address any resulting economic/social challenges, Netflix can recommend movies for you based on your history, this makes you stay glued to them, which eventually generates more revenue for them, YouTube suggests videos for you based on your past activities, you are tempted to watch more which means more money for them.
So what's data analysis in real life all about? Three basic things; 1. Why collecting the data? 2. What conclusion (actionable insights) are we making from the analysis? 3. How does the conclusion affect the growth or otherwise of the company?
The takeaways...
When carrying out any analysis, ask yourself or the client these questions; 1. What is the objective of the analysis? 2. Do we have research questions we are trying to answer? 3. Do we have any research hypothesis (which eventually leads to conclusion) ?
The above are what your visualizations and statistical analysis tell you. The more experienced you are, the more accurate you are likely to get the steps.
I hope you find this useful and grow with it. You have spoken well. Thanks for your verbose explanation, I really picked some insights from it. I would like to ask; at the emboldened part: a. In the example, I suppose a two paired hypothesis test would give us the answer, right? b. I couldn't think of anyway of statically analyzing the data. I guess that's where Machine Learning come into play since we want to predict an outcome Are my answers correct? |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 11:46pm On Sep 26, 2020 |
Dahyormine: Good move, just decide and settle for one, learning the two is not necessary. I have seen job descriptions that requires knowledge of PowerBI and others that states "Knowledge of Tableau is compulsory" By the way, what PowerBIcourse do you recommend for me? |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 6:30pm On Sep 26, 2020 |
Dahyormine: IMO, Power BI is Python and Excel combined, apart from ML.
initially I learnt PBI using Kiril Eremenko's course on Udemy, he only treated visualisation, in 3days I was done and I felt like what's the hype about PBI since its only Drag and drop... lol I went back learning python till I was comfortable.
I was making research, then i discovered I could do more with PBI. I went back and got another video on udemy like 5gig content. mehn this guy broke down PBI in and out.
basically PBI is divided into 3parts, visualisation, Power Query and DAX... with Power query, you can manipulate and query data to taste. with DAX, you can carry out any data analysis calculation(This is deep). Formally, when I wanted to do any anything involving datetime analysis and Forecast, I would use Statsmodel's ARIMA in Python, and that could take average of 10lines of serious Code, when I came across PBI, I could forecast with 3-4 clicks... mehn I was stunned. most people don't know that one can Webscrape with PBI, you can do allota wonders with that monster package. I would advice everyone to take full advantage of it if you really wanna go deep in Data Analytics.
you can contact me for materials or link to good materials. peace
Edit: When it comes to Business Intelligence, it has Data modelling ability where you can link many Datasets together so they interact as one and so many more. Interesting! Do you have links to the material(s) that helped you when learning? I'm close to finishing the Statistics course with Excel that I have been learning. My next plan is to learn PowerBI & Tableau. |
Travel › Re: Canadian Express Entry/federal Skilled Workers Program - Connect Here Part 10 by BelieverDE: 12:18pm On Sep 26, 2020 |
Kekereekun123: only ircc can answer that. But in my opinion since you did nothing its not right to claim it. You're right. I suppose I'd have to apply for graduate trainee positions which I can use in lieu of NYSC experience. |
Travel › Re: Canadian Express Entry/federal Skilled Workers Program - Connect Here Part 10 by BelieverDE: 11:58am On Sep 26, 2020 |
Kekereekun123: one year experience cannot give your the required scores. You need 3 years or french tef to meet up. Read up page 1 and also use the tool https://www.cic.gc.ca/english/immigrate/skilled/crs-tool.asp Thanks, Kekereekun123. I totally understand that my one year NYSC experience cannot meet up but I have read from this thread where people combined their NYSC experience with work experience gotten from other organizations. I would like to know if I can still combine my current NYSC teaching experience (which I don't have as a result of the lockdown. I only spent 6 days in the NYSC camp before we were all sent home) and other work experience in future? I don't want a situation where it's going to pose as a problem in future when I intend applying for the FSW program. |
|
|
Travel › Re: Canadian Express Entry/federal Skilled Workers Program - Connect Here Part 10 by BelieverDE: 10:11am On Sep 26, 2020 |
Hello good people of nairaland,
I am currently a corps member who will pass out in the month of March, 2021. I learned that I can use my NYSC experience for a particular NOC. Due to the pandemic I have no teaching experience acquired during NYSC and I intend to use a reference letter from my PPA employer in the future.
If I successfully obtain a reference letter that meets the requirements of my primary NOC, wouldn't it be obvious that it's false since the country was on lockdown then? |
Travel › Re: Canadian Express Entry/federal Skilled Workers Program - Connect Here Part 10 by BelieverDE: 12:18pm On Sep 25, 2020*. Modified: 2:40pm On Sep 25, 2020 |
Honeydoc: I dint need to start one. There is a telegrm group i joined. Drop your telegram id so i can request for you to be added. Please add me to the Telegram group. My username is Maplemann |
Travel › Re: General-german-student-visa-enquiries Part 8 by BelieverDE: 11:57am On Sep 25, 2020 |
chi555: www.nisig.de/summit
The Nigerian Scholars in Germany are having their annual summit and its online for the first time due to the CoVID situation. If you are interested to meet and network with scholars already in germany, u could register for the event. Its a full day event with topics such as Job application in Germany, doing a PhD in Germany etc. Check it out via the link above. Danke |
Jobs/Vacancies › Re: State Civil Service Job Or Multinational Company Job? Which One Is Advisable? by BelieverDE: 1:08pm On Sep 24, 2020 |
"Whenever you find yourself at crossroads, choose the path that scares you more, that's your path to greatness." |
Travel › Re: DON'T LISTEN TO Anyone Who Discourages You From Travelling Abroad by BelieverDE: 3:17pm On Sep 22, 2020 |
Basalt: Happy New Year everyone. During these days of silence, I was able to meet with many experienced people who were all students before and now comfortably working. One (29yrs) is working in NRW as an environmental scientist on a salary scale of 52k per year and he got the job within 4 months of graduation. I asked him for his secrets and he told me that I should worry less about the course I am studying and focus on personal development. That even if I am studying how to cut cook food in Germany, I should learn it well and be able to hold a conversation in Deutsch. He also mentioned that I should try all means to learn any programming language related to my field. He said for my field, I need to learn Python/Matlab and how to use it to analyze data very well. That by now I should be aware that I should be working on getting at least B2 German certificate before graduating and if possible convert my Nigerian driver's license to a German driver's license. He said many things all centered on self-development. Hey Basalt, It's been a while. How're you doing? I hope you've able to improve your German language skill or learn python for Data analysis? I just re-read your thread and it's really thrilling reading your posts. I just wanted to remind you of this  |
Travel › Re: Nigerian In Russia-my Experience So Far by BelieverDE: 1:39pm On Sep 22, 2020 |
Thanks Austeen007. The truth about Russia is really an eye opener.
Could you please tell us about the "little crime" that can land someone in prison? I heard greeting people the Nigerian way (raising you hand in the air) is prohibited in Germany because it's similar to the way Hitler greets.
In the UAE you can't stare at a woman. There are a lot of "little crimes" an individual must know. Could you please let us know "little crime" which could be strange to a Non-European? |
Travel › Re: Beware Of Fourshores Travel Agency by BelieverDE: 10:19am On Sep 22, 2020 |
|
Travel › Re: Nigerian In Russia-my Experience So Far by BelieverDE: 3:14pm On Sep 20, 2020*. Modified: 7:33pm On Sep 20, 2020 |
Austeen007: The most smartest people on earth are the ones that asks the most questions. I love this statement of yours!  |
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 11:43pm On Sep 18, 2020 |
|
Programming › Re: Chronicle Of A Data Scientist/analyst by BelieverDE: 8:16pm On Sep 18, 2020 |
Olamyyde: Drop the magnet link or torrent link here, i will upload it to my google drive and share it to you. Do you have Machine Learning A-Z by Kirill Eremenko course on your drive so I could quickly download? |
Travel › Re: Nigerian In Russia-my Experience So Far by BelieverDE: 4:35pm On Sep 17, 2020 |
This is a nice thread, Austeen007. With what you have wrote up here I'm beginning to have a very soft spot for Russians  . However, I lost interest totally in the country when I did a currency conversion between their Ruble and our Naira.
|
Travel › Re: My waka poxgram by BelieverDE: 9:23pm On Sep 15, 2020 |
jerikoyan: . I know it's unethical to quote you on an old thread, but I just can't help it! The pictures of the Great Canyon are amazing |
Travel › Re: Road/ferry Trip Bonn Germany To Lista Southern Norway by BelieverDE: 9:11pm On Sep 15, 2020 |
jerikoyan: Hi Guys, so am on a visit to the United States for the first time and will be visiting the Grand Canyon Natural Park in Arizona(one of the 7 natural wonders of the world) this weekend 30th Dec. Will create a new thread for it or simply use this one. Season greetings to you and your loved ones I just saw this thread. Your journey must have been a thrilling experience. Did you just mention the Grand Canyon? You definitely must be a Geoscientist!  |