Olga TData Mining and Analytics Expert
Bio

Creative, highly motivated, results driven professional who combines broad business sense and sound technical background. Passion for data-driven decision making. Proficient in analysis of diverse data in order to generate business insights and in-depth understanding of customer behaviour.



Recent Answers


Hi,
I don't have a simple solution that I could suggest to you now. But I have a question for you: if you found a product, that would do that for you (a computer software, that would get all the information/updates from different websites, combine it in one place and optimize for you to absorb) would you buy it?

I am a data analyst and my specialty is text analytics. I can take large amounts of text and find some meaning in it. For example, get a set of law documents and programmatically analyze it to build an argument; or I can take pictures of food from someone's instagram account and predict person's weight in 2020. So, I have an idea how to solve a problem like yours.

What I can recommend for you right now, is a VA (virtual assistant). I have one myself. She takes care of the information flow. Reading, summarizing, writing lists and notes, making charts, etc. It isn't very expensive, and you can hire some great, highly educated people that are undervalued by an average employer (stay-home moms, fresh grads, people living in remote locations, etc).


There are so many ways to do it... Do you need this data for yourself, or you are planning to make a product around it?

From what I see you can use Twitter API and Facebook Graph API (Are you comfortable programming?) Most of the students are active on social media so you will find lots of data. Facebook graph API will give you a number of likes and comments to all the posts of you competitors. You can analyze all the posts of your competitors. Using Twitter API you can get all the twits that use certain hashtags or mentions. If you are not into coding, but still want to get social media information, you can take a look at tools like IBM Watson ANalytics ($30 for personal use), it natively connects to Twitter API, and you don't have to be a programmer at all. It is intuitive and easy to learn. Analytics Canvas connects to Facebook Graph API (it's free for 30 days of trial).

Unfortunately, you would not be able to collect any personal information from social media at large scale (age, income, gender, etc.), because it violates all the laws about privacy on the Internet. You can use census data instead.

Google Sheets are a very handy tool if you are planning to use this information for personal research. You can set up a spreadsheet and add some Java script to make it collect all information from competitor's blogs, and also sites like Reddit.

Finally, you can try web scraping (it's not the best, but can speed up the process). A tool like OutWitHub will collect information from websites (such as website reviews) based on the structure you provide (select html tags). You can collect thousands of reviews in one day if you automate it (paid version). Very easy to use.

Note: not all the websites are open to this method, review their policies to make sure you are not violating their terms of service. Reviews belong to the website where they were published.

If you REALLY need personal data (like how much they earn and how much they spend, etc.), just print out 100 questionnaires and go to Student Union Building of Dalhousie University. Most of the students will share any personal data in exchange for a Tim Horton's gift card that gets them a free coffee. It is probably the least technical and fastest way to get all the data you need.

Hope this helps.


Contact on Clarity

$ 2.50 /min

N/A Rating
Schedule a Call

Send Message

Stats

2

Answers
Calls


Access Startup Experts

Connect with over 20,000 Startup Experts to answer your questions.

Learn More

Copyright © 2019 Startups.com LLC. All rights reserved.