Drive To Discover
Silicon Valley's new buzzword
Apps are so yesterday. There's a new buzzword in Silicon Valley: Big Data. It's a phenomenon driven by the likes of Google and Facebook. When you make a connection on Facebook, you can thank Big Data. When you get a flu shot, you can thank Big Data.
It's a field so new that few schools offer a degree in it. Yet demand is surging for data scientists, the hottest job title in Silicon Valley.
"For most companies right now," says Amrit Williams, "the real problem with getting value out of data is a lack of sophistication in talent. We have a major drought of qualified people who can ask the right questions."
Williams is chief technology officer of Emeryville-based Quantivo, one company in the vanguard of a new Big Data industry, developing analytical tools for business big and small.
"People are looking at all this data, going, 'I know it's interesting for me to collect Twitter data. I know it's interesting for me to understand what my customers are doing on Facebook. I know it's interesting for me to understand what they do online. But what's the question I'm trying to ask? And what's the answer I want?'"
For the first time, Big Data has its own convention, the Strata conference, inaugurated by O'Reilly Media of Sebastopol -- where Edd Dumbill's job is to stay in front of this trend.
"For a lot of people," he says, "the first Strata conference crystalized that they were data scientists, there were other people who were data scientists, so this is a profession, working with large datasets. And now it's a highly-in-demand job title."
For years, big retailers collected volumes of data about their customers. But they struggled to make sense of it. There was too much, and it was too unstructured. Then came the perfect storm: cloud computing, open source, and Internet companies that eat whole planets of data for breakfast. Now Google and others are sharing their technology.
jobs, silicon valley, computers, google, facebook, drive to discover
- One dead, another critical in San Francisco fire
- Police arrest suspect accused of setting fire to station
- Police search for men over attempted bank robbery
- Teen girl found in Berkeley says she was kidnapped
- BART unveils new train car design in SF
- Woman struck by cab in downtown San Francisco 37 min ago
- 2 people shot at Richmond strip mall
- Martinez parents struggle to stay at baby son's side
- Florida school board member wants parent dress code
- SF leaders to announce plan to deal with "420" events
- Woman attempting run from San Francisco to New York 4 min ago
- VIRAL VIDEO: "World's toughest job" interview
- weather: Bay Area weather forecast for Wednesday
- roundup: Fatal house fire in SF; Oakland shooting
Most Viewed StoriesMost Viewed Photos