What are the major headaches of your daily data related work?

For example: -Tons of tools but with little data connection -Repeated time and effort consuming report or analysis -Worthless data overload -Inefficiency or insufficiency of information sharing


It's unlikely I'm part of your target demographic for this question. But you've given me the opportunity to vent; therefore vent I shall!

Gripe 1: Yesterday I spent hours writing a parser that takes a raw-text output from Bob's database and chops it up appropriately for insert into Bill's database. If Bob would just give Bill access to the database, then such a parser wouldn't be required.

Gripe 2: I spend an inordinate amount of time coding up processes that really accomplish nothing but data entry. The tasks are too small for it to be worthwhile to program spiders to crawl the information sources, but they're too significant to neglect. I'd much rather outsource this stuff, but I spend more time explaining these one-off tasks to people overseas than it takes me to perform them myself!

Gripe 3: Many of my data-collection tasks are massive and repetitive. Does anyone out there know a good source of trainable crawlers / scrapers? My difficulty is that I need them for a series of unpredictable mid-term tasks rather than a consistent long-term task.

Answered 7 years ago

Too much time spent on reporting and not enough time on analysis. And not enough attention paid to recomendation often due to lack of processes. Inaccurate data from poor implementation. Lack of documentation and planning towards data processes.

Answered 7 years ago

Unlock Startups Unlimited

Access 20,000+ Startup Experts, 650+ masterclass videos, 1,000+ in-depth guides, and all the software tools you need to launch and grow quickly.

Already a member? Sign in

Copyright © 2022 LLC. All rights reserved.