Thread regarding SAS Institute layoffs

Whatever happened to "Big Data" ?

I don't hear much about "Big Data" anymore. Was it a fad? Did brute force processing of big data prove unnecessary? Did business choose and anoint a particular vendor's product or has brute force been replaced by AI?

Viya was originally about massively parallel processing but has the market settled on a solution to that kind of data processing or moved beyond that idea? Technically superior products don't necessarily succeed if others are faster to market or market conditions change, right? What has happened?


by
| 1733 views | | 13 replies (last September 12) | Reply
Post ID: @OP+1k4w572z0

13 replies (most recent on top)

"Tesla (ev)
AWS
Facebook

The list is very long..."

The list is very false.

Tesla and Facebook each needed less than a decade to IPO. Facebook was the dominant social media platform well before its IPO. AWS, a subsidiary of Amazon, never IPO'd, but most of Amazon's retail sites were using it before a decade had passed.

These facts are easy to check. I wish Viya would succeed, but lies won't help it.

by
| | Reply
Post ID: @g2+1k4w572z0

"I'm sure they were also experts at the hot buzzword that proceeded Big Data".

Before the term "Big Data" gained traction in the early 2000s, the buzzword of choice was Business Intelligence (BI).

by
| | Reply
Post ID: @fs+1k4w572z0

Google question/answer:
What is big data in AI?

In AI, big data refers to the large, complex, and diverse datasets that act as the "fuel" for AI systems, enabling them to learn, identify patterns, and make sophisticated decisions. Big data possesses characteristics like high Volume, rapid Velocity, and varied Variety, which traditional methods struggle to process but AI-powered analytics can effectively analyze to extract valuable insights and drive innovation.

The Relationship Between Big Data and AI
AI relies on big data: AI systems require vast amounts of data to train their algorithms, enabling them to develop human-like reasoning, learn from historical information, and improve their decision-making processes.
Big data relies on AI: Big data analytics tools use AI to process, interpret, and analyze these massive, complex datasets, uncovering trends and correlations that would be impossible to find manually.

Key Characteristics of Big Data (The "Vs")
Volume: The sheer quantity of data being generated at unprecedented rates from sources like the internet and IoT devices.
Velocity: The speed at which data is generated and needs to be processed, such as in real-time financial systems.
Variety: The different types of data, including structured (like spreadsheets), unstructured (like text or video), and semi-structured data.
Veracity: The trustworthiness and accuracy of the data, emphasizing the need for cleaning and validation.
Value: The ultimate goal of big data analysis, which is to extract meaningful and actionable insights.

How AI Uses Big Data
Training: AI models are trained on big data to recognize patterns, anomalies, and correlations within the datasets.
Analysis: AI-powered analytics can process complex, mixed data types (text, images, video, etc.) to derive meaningful insights quickly.
Decision-Making: AI uses the insights derived from big data to support data-driven decisions, provide personalized recommendations, and improve efficiency in various applications.

by
| | Reply
Post ID: @fr+1k4w572z0

@ar

“Big Data” retired to the Florida Keys.

From what I've heard, it would be more accurate to say "was retired", not "retired".

by
| | Reply
Post ID: @fp+1k4w572z0

it was used to train foundation models so now all we hear about is "gen AI"

by
| | Reply
Post ID: @cx+1k4w572z0

@ca+1k4w572z0

proceeded
preceded

by
| | Reply
Post ID: @cp+1k4w572z0

I dunno but all the Big Data talking heads are now AI talking heads. I'm sure they were also experts at the hot buzzword that proceeded Big Data

by
| | Reply
Post ID: @ca+1k4w572z0

“ Really? Name a product of similar scope to Viya that suddenly took off after a decade+ of dormancy.”

Tesla (ev)
AWS
Facebook

The list is very long. Obviously there are differences between all of the, and I’m not saying Viya is AWS. But I answered the snarky question you asked

by
| | Reply
Post ID: @by+1k4w572z0

Does SAS still have a VP of Big Data (the title originally given to P.K.)?

by
| | Reply
Post ID: @bm+1k4w572z0

"There is still hope for Viya."

Really? Name a product of similar scope to Viya that suddenly took off after a decade+ of dormancy.

by
| | Reply
Post ID: @ba+1k4w572z0

“Big Data” retired to the Florida Keys.

by
| | Reply
Post ID: @ar+1k4w572z0

Big data is the norm, its no longer a wow effect or bragging right.

by
| | Reply
Post ID: @ab+1k4w572z0

It hasn’t gone away. There is still hope for Viya.

by
| | Reply
Post ID: @a6+1k4w572z0

Post a reply

: