How to Build a Data Foundation for Generative AI

Generative AI is not just a general-purpose productivity aid that surfaces information the way a search engine does; with gen AI, organizations can combine their unique, proprietary data with foundation models that have been pre-trained on a broad base of public data.
Trained on a combination of public and proprietary data, generative AI may become the most knowledgeable entity within an organization, opening up innumerable opportunities for innovation.
As with all analytics, generative AI is only as good as its data.
To fully leverage AI, an organization needs mastery over its proprietary data.
This means a solid foundation of data operations technologies and organizational norms that facilitate responsible and effective use of data.
The ability to move and integrate data from databases, applications, and other sources in an automated, reliable, cost-effective, and secure manner.
Knowing, protecting, and accessing data through data governance.
This kind of data readiness is perennially overlooked and has historically derailed many attempts to leverage the power of big data and data science.
One metric suggests that as many as 87 percent of data science projects never make it to production, often because of siloed and ungoverned data as well as underdeveloped data infrastructure.
Generative AI Depends on a Foundation of Data Maturity Without data maturity, the prototyping, deployment, and testing of generative AI - or indeed, any kind of analytics - becomes extremely difficult.
A central, cloud-based data repository that can serve as a single source of truth.
Ability to block and hash sensitive data before it arrives in a central repository.
Good visibility into your data, as exemplified by cataloging of data assets.
Your Data Platform Architecture for Generative AI Building generative AI from scratch is a colossal undertaking, with the potential to cost hundreds of millions of dollars and the equivalent of hundreds of years.
Your organization is most likely to use a base or foundation model - a commercially available model already trained on huge volumes of public data.
In the initial stages, this architecture mirrors basic analytics use cases, requiring a data pipeline to extract, load, and transform raw data into models for supporting reports, dashboards, and other data assets.
Convert text into enumerations, store in a vector database for generative AI to integrate into long-term memory, enhancing results from initial training and unique organizational data.
Even with the help of an increasing number of off-the-shelf tools for managing data infrastructure with generative AI, it is likely that you will need to lean heavily on engineering, data science, and AI expertise to make the parts function properly with each other and build usable applications on top of the architecture.
The potential of generative AI can only be fully realized when organizations recognize the pivotal role of their proprietary data.
By prioritizing mastery over data through the implementation of advanced data operations technologies and cultivating a culture of responsible data use, organizations can unlock the true power of generative AI, ensuring its optimal performance and ethical deployment in a rapidly advancing technological landscape.


This Cyber News was published on feeds.dzone.com. Publication date: Fri, 19 Jan 2024 21:13:04 +0000


Cyber News related to How to Build a Data Foundation for Generative AI

How to perform a proof of concept for automated discovery using Amazon Macie | AWS Security Blog - After reviewing the managed data identifiers provided by Macie and creating the custom data identifiers needed for your POC, it’s time to stage data sets that will help demonstrate the capabilities of these identifiers and better understand how ...
1 month ago Aws.amazon.com
How to Build a Data Foundation for Generative AI - Generative AI is not just a general-purpose productivity aid that surfaces information the way a search engine does; with gen AI, organizations can combine their unique, proprietary data with foundation models that have been pre-trained on a broad ...
9 months ago Feeds.dzone.com
11 GenAI cybersecurity surveys you should read - Generative AI stands at the forefront of technological innovation, reshaping industries and unlocking new possibilities across various domains. As the integration of these technologies continues, a vigilant approach to ethical considerations and ...
10 months ago Helpnetsecurity.com
4 key devsecops skills for the generative AI era - Experts believe that generative AI capabilities, copilots, and large language models are ushering in a new era of how developers, data scientists, and engineers will work and innovate. They expect AI to improve productivity, quality, and innovation, ...
10 months ago Infoworld.com
Building a Sustainable Data Ecosystem - Finally, I outline future research and policy refinement directions, advocating for a collaborative and responsible approach to building a sustainable data ecosystem in generative AI. In recent years, generative AI has emerged as a transformative ...
7 months ago Feeds.dzone.com
CVE-2024-26626 - In the Linux kernel, the following vulnerability has been resolved: ...
8 months ago
What Lurks in the Dark: Taking Aim at Shadow AI - Security teams are confronting a new nightmare this Halloween season: the rise of generative artificial intelligence. Generative AI tools have unleashed a new era of terror for chief information security officers, from powering deepfakes that are ...
11 months ago Darkreading.com
Social engineering in the era of generative AI: Predictions for 2024 - Breakthroughs in large language models are driving an arms race between cybersecurity and social engineering scammers. For businesses, generative AI is both a curse and an opportunity. It's not just AI models themselves that cyber criminals are ...
5 months ago Securityintelligence.com
AI Is Changing the Way Enterprises Look at Trust: Deloitte & SAP Weigh In - Whether you are creating or customizing an AI policy or reassessing how your company approaches trust, keeping customers' confidence can be increasingly difficult with generative AI's unpredictability in the picture. We spoke to Deloitte's Michael ...
4 months ago Techrepublic.com
Cohesity partners with NVIDIA to harness the power of generative AI - Cohesity announced a collaboration with NVIDIA to help organizations safely unlock the power of generative AI and data using the recently announced NVIDIA NIM microservices and by integrating NVIDIA AI Enterprise into the Cohesity Gaia platform. ...
7 months ago Helpnetsecurity.com
Navigating the New Frontier of AI-Driven Cybersecurity Threats - A few weeks ago, Best Buy revealed its plans to deploy generative AI to transform its customer service function. Best Buy's initiative is a harbinger of generative AI deployment in enterprise settings, aiming to increase productivity and improve ...
5 months ago Securityboulevard.com
Transforming the Creative Sphere With Generative AI - Generative AI, a trailblazing branch of artificial intelligence, is transforming the creative landscape and opening up new avenues for businesses worldwide. This article delves into how generative AI transforms creative work, including its benefits, ...
9 months ago Cysecurity.news
Generative AI Redefines Cybersecurity Defense Against Advanced Threats - In the ever-shifting realm of cybersecurity, the dynamic dance between defenders and attackers has reached a new echelon with the integration of artificial intelligence, particularly generative AI. This technological advancement has not only armed ...
8 months ago Cysecurity.news
Generative AI Takes on SIEM - With more vendors adding support for generative AI to their platforms and products, life for security analysts seems to be getting deceptively easier. While adding generative AI capabilities to security information and event management is still in ...
11 months ago Darkreading.com
Securing Generative AI: Navigating Risks and Strategies - The introduction of generative AI has caused a paradigm change in the rapidly developing field of artificial intelligence, posing both unprecedented benefits and problems for companies. The need to strengthen security measures is becoming more and ...
10 months ago Cysecurity.news
Generative AI's enterprise gamble: IT leaders bet big on tech despite security woes - Enterprise IT teams are moving swiftly to adopt generative artificial intelligence systems like ChatGPT, according to a new report from Glean and ISG. The report found that IT leaders see generative AI as transformational and are willing to increase ...
9 months ago Venturebeat.com
3 Ways the CTO Can Fortify the Organization in the Age of Generative AI - An August survey by BlackBerry found that 75% of organizations worldwide were considering or implementing bans on ChatGPT and other generative AI applications in the workplace, with the vast majority of those citing the risk to data security and ...
8 months ago Securityboulevard.com
How enterprises are using gen AI to protect against ChatGPT leaks - ChatGPT is the new DNA of shadow IT, exposing organizations to new risks no one anticipated. Enterprise workers are gaining a 40% performance boost thanks to ChatGPT based on a recent Harvard University study. A second study from MIT discovered that ...
9 months ago Venturebeat.com
Generative AI vs. Predictive AI: A Cybersecurity Perspective - In the context of cybersecurity, AI promises considerable benefits however there's still a lot of confusion surrounding the topic, particularly around the terms generative AI and predictive AI. Given the high failure rate for AI projects let's ...
4 months ago Securityboulevard.com
How Criminals Are Leveraging AI to Create Convincing Scams - Cybercriminals create far more sophisticated scams with generative AI than traditional phishing scams. According to Visa research, scammers are fooling even the savviest internet users by launching pig butchering, inheritance, humanitarian relief ...
5 months ago Tripwire.com
Europe Reaches a Deal on the World's First Comprehensive AI Rules - European Union negotiators clinched a deal Friday on the world's first comprehensive artificial intelligence rules, paving the way for legal oversight of AI technology that has promised to transform everyday life and spurred warnings of existential ...
10 months ago Securityweek.com
5 free generative AI courses you can take right now - Generative AI is a form of artificial intelligence technology focused on generating new content. This can include text, images, audio, and other media types. It's a rapidly evolving field with significant implications in various industries, ...
10 months ago Helpnetsecurity.com
New Microsoft Purview features use AI to help secure and govern all your data - More than 90% of organizations use multiple cloud infrastructures, platforms, and services to run their business, adding complexity to securing all data.1Microsoft Purview can help you secure and govern your entire data estate in this complex and ...
10 months ago Microsoft.com
Fortinet Adds Generative AI Tool to Security Operations Portfolio - Fortinet today added a generative artificial intelligence tool to its portfolio to eliminate a range of manual tasks that security operations teams would otherwise need to perform. John Maddison, chief marketing officer for Fortinet, said Fortinet ...
10 months ago Securityboulevard.com
CVE-2009-3027 - VRTSweb.exe in VRTSweb in Symantec Backup Exec Continuous Protection Server (CPS) 11d, 12.0, and 12.5; Veritas NetBackup Operations Manager (NOM) 6.0 GA through 6.5.5; Veritas Backup Reporter (VBR) 6.0 GA through 6.6; Veritas Storage Foundation (SF) ...
6 years ago

Latest Cyber News


Cyber Trends (last 7 days)


Trending Cyber News (last 7 days)