Drive To Discover
Silicon Valley's new buzzword
Apps are so yesterday. There's a new buzzword in Silicon Valley: Big Data. It's a phenomenon driven by the likes of Google and Facebook. When you make a connection on Facebook, you can thank Big Data. When you get a flu shot, you can thank Big Data.
It's a field so new that few schools offer a degree in it. Yet demand is surging for data scientists, the hottest job title in Silicon Valley.
"For most companies right now," says Amrit Williams, "the real problem with getting value out of data is a lack of sophistication in talent. We have a major drought of qualified people who can ask the right questions."
Williams is chief technology officer of Emeryville-based Quantivo, one company in the vanguard of a new Big Data industry, developing analytical tools for business big and small.
"People are looking at all this data, going, 'I know it's interesting for me to collect Twitter data. I know it's interesting for me to understand what my customers are doing on Facebook. I know it's interesting for me to understand what they do online. But what's the question I'm trying to ask? And what's the answer I want?'"
For the first time, Big Data has its own convention, the Strata conference, inaugurated by O'Reilly Media of Sebastopol -- where Edd Dumbill's job is to stay in front of this trend.
"For a lot of people," he says, "the first Strata conference crystalized that they were data scientists, there were other people who were data scientists, so this is a profession, working with large datasets. And now it's a highly-in-demand job title."
For years, big retailers collected volumes of data about their customers. But they struggled to make sense of it. There was too much, and it was too unstructured. Then came the perfect storm: cloud computing, open source, and Internet companies that eat whole planets of data for breakfast. Now Google and others are sharing their technology.
jobs, silicon valley, computers, google, facebook, drive to discover
- Oakland hospital ordered to keep girl on life support
- Santa makes early visit to Tenderloin school
- Woman hit by stray bullet may be paralyzed
- Senator Harry Reid in hospital for observation
- 1 injured in shooting at Bayfair Mall in San Leandro
- AC Transit, unions announce tentative agreement
- What's next for Candlestick Point?
- Dying cancer patient's friend offers to be surrogate
- Big Sur wildfire is fully contained
- Bay Area companies shop so you won't have to
- GET FREE STUFF: Cream cheese; Bracelet set
- Bay Area New Year's Eve fireworks and events
- roundup: Oakland shooting; DUI checkpoints
- weather: Bay Area weather forecast for Saturday