logo
Teradata launches on-premises AI Factory for secure private AI

Teradata launches on-premises AI Factory for secure private AI

Techday NZ25-06-2025
Teradata has announced the launch of Teradata AI Factory, an integrated solution delivering the company's cloud-based artificial intelligence (AI) and machine learning (ML) capabilities to secure, on-premises environments.
The AI Factory has been built in collaboration with NVIDIA and unifies key components including data pipelines, algorithm execution, and software infrastructure into a single, scalable system. The solution is intended to accelerate AI development—covering predictive, generative, and agentic AI—through private deployments while facilitating governance, compliance, and security for enterprises.
Teradata AI Factory is designed to integrate software, hardware, and a combination of Teradata and third-party tools, aiming to decrease both compliance risks and costs. When paired with Teradata AI Microservices with NVIDIA and customer-provided NVIDIA GPUs, the platform supports accelerated development, including native Retrieval-Augmented Generation (RAG) pipelines, which are increasingly in demand among data-driven organisations.
The company has positioned this solution as particularly relevant for industries with high regulatory requirements, such as healthcare, finance, and government, as well as any enterprise needing greater control and autonomy over AI strategy and deployments.
Changing requirements
According to the company, current global instability and stricter data sovereignty regulations are influencing organisations to seek more control over their AI infrastructure. These factors coincide with financial pressures that can result from both underused GPU investments and variable cloud computing costs, especially within hybrid enterprise environments. The increasing complexity of AI ecosystems is expected to further drive demand for integrated, turnkey solutions that can address both cost and governance issues. "Market dynamics are increasing buyer interest in on-premises solutions," said Teradata's Chief Product Officer, Sumeet Arora. "Teradata remains the clear leader in this environment, with proven foundations in what makes AI meaningful and trustworthy: Top-notch speed (performance), predictable cost (resource efficiency), and integration with the golden data record (which may already live on Teradata). Teradata AI Factory builds on these strengths in a single solution for organisations using on-prem infrastructure to gain control, meet sovereignty needs, and accelerate AI ROI."
A recent report from Gartner states: "By 2028, more than 20% of enterprises will run AI workloads (training or inference) locally in their data centers, an increase from approximately 2% as of early 2025." ("How to Determine Infrastructure Requirements for On-Premises Generation AI" by Chandra Mukhyala, Jonathan Forest, Tony Harvey from March 5, 2025)
Feature set
Teradata AI Factory is structured to provide enterprises with a comprehensive on-premises AI solution incorporating security, cost efficiency, and seamless hardware-software integration. Its feature set includes Teradata's Enterprise Vector Store as well as Teradata AI Microservices, the latter of which leverages NVIDIA NeMo microservices to enable native RAG pipeline capabilities.
The platform's architecture aims to address sensitive data requirements by keeping data within the organisation's boundaries, thereby reducing the risks commonly associated with public or shared AI platforms—including data exposure, intellectual property leakage, and challenges with regulatory compliance. Teradata AI Factory supports compliance with established standards such as GDPR and HIPAA, positioning it as an option for organisations where data residency and privacy are priorities.
Its localised set-up is designed to facilitate high levels of AI performance while lowering latency and operational inefficiency due to reduced data movement. Customers can choose to deploy AI models on CPUs or accelerate performance using their existing GPU infrastructure. This approach seeks to avoid unpredictable cloud expenses, allowing organisations to maintain consistent operational costs and prepare for scaled private AI innovation going forward.
Technical integration
Teradata AI Factory presents an integrated, ready-to-run stack for AI applications. It includes: AI Platform for Rapid Innovation: Built on Teradata's IntelliFlex platform, the AI Factory incorporates Teradata Enterprise Vector Store, enabling integration of structured and unstructured data for generative AI applications.
Built on Teradata's IntelliFlex platform, the AI Factory incorporates Teradata Enterprise Vector Store, enabling integration of structured and unstructured data for generative AI applications. Software Infrastructure: The AI Workbench provides a self-service workspace with access to analytics libraries, including those from ClearScape Analytics. It also offers model lifecycle management, compliance tools, one-click large language model (LLM) deployment, and supports JupyterHub, ModelOps, Airflow, Gitea, and Devpi.
The AI Workbench provides a self-service workspace with access to analytics libraries, including those from ClearScape Analytics. It also offers model lifecycle management, compliance tools, one-click large language model (LLM) deployment, and supports JupyterHub, ModelOps, Airflow, Gitea, and Devpi. Algorithm Execution: The system supports scalable execution of predictive and generative algorithms, facilitating high performance through connections with customer GPUs and delivering native RAG processing.
The system supports scalable execution of predictive and generative algorithms, facilitating high performance through connections with customer GPUs and delivering native RAG processing. Data Pipelines: The solution includes data ingestion tools and internal capabilities like QueryGrid, Open Table Format (OTF) compatibility, object store access, and support for NVIDIA utilities for complex data formats such as PDFs.
By processing data locally within an organisation's infrastructure, Teradata AI Factory is intended to enhance data security and operational integrity, providing greater control and certainty for those adopting private AI strategies.
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Samsung is looking into more AI devices - potentially including earrings and necklaces
Samsung is looking into more AI devices - potentially including earrings and necklaces

RNZ News

time21 hours ago

  • RNZ News

Samsung is looking into more AI devices - potentially including earrings and necklaces

By Lisa Eadicicco , CNN A man tries on smart glasses capable of real-time translation. Photo: Lian Yi / Xinhua via AFP Samsung is looking into new wearable devices, potentially including earrings and necklaces, amid an industry-wide push to develop new types of AI-powered consumer electronics. AI could enable a new wave of devices that allow users to communicate and get things done more quickly without having to take out a phone, Won-joon Choi, chief operating officer for Samsung's mobile experience division, told CNN this week. For Samsung, these types of new devices could be something you wear around your neck, dangle from your ears or slip on your finger . "We believe it should be wearable, something that you shouldn't carry, (that) you don't need to carry," he said. "So it could be something that you wear, glasses, earrings, watches, rings and sometimes (a) necklace." Choi's comments underscore the opportunity tech giants see to develop new hardware products around AI, a technology that some say is expected to be as impactful as the internet itself. AI services like OpenAI's ChatGPT and Google's Gemini have moved beyond basic text prompts and are getting better at handling complex tasks. That's led tech giants to look into devices that require less manual input than smartphones, which largely require typing and swiping on screens. That search is already in full swing, starting with smart glasses. Meta has touted its AI-powered Ray-Ban smart glasses, of which 2 million have been sold since 2023, as a success. The Facebook parent also recently acquired a minority stake in Ray-Ban parent company EssilorLuxottica, according to Bloomberg, further indicating the company's interest in AI-powered wearable gadgets. Samsung, Google and Snap are also developing smart glasses, while OpenAI and ex-Apple designer Jony Ive are collaborating on a mysterious new AI device for next year. When CNN asked Choi whether Samsung is actively looking into developing earrings or other smart jewelry, like a pendant or bracelet, Choi said the company is "looking at all kinds of possibilities". "What do you wear? Glasses, earrings… necklaces, watches and rings, something like those," he said. However, that doesn't mean those possibilities will become products. Samsung and other tech companies routinely develop prototypes and evaluate new technologies internally without bringing them to market. Some tech startups have already unsuccessfully tried to develop new AI gadgets to replace smartphones at certain tasks. The Humane AI Pin, created by a pair of Apple veterans, flopped because of its high price and buggy performance. The company shut down the product and sold parts of itself to computing giant HP in February. Another device called the Rabbit R1 also launched to a lackluster reception last year, although it's undergone significant updates since then. And a startup called Friend created an AI necklace that's meant to be a digital companion, although its launch has been delayed until the third quarter of this year. Samsung's approach, unlike some of these options, will involve a device that's a companion to your phone rather than a standalone product, similar to the company's smartwatches, according to Choi. And the company's upcoming smart glasses, which it hasn't revealed many details about yet, could be just the start. "We are actively working on glasses, but some people do not want to wear glasses because they change their look," he said. "So we are also exploring other types of devices." - CNN

Clear laws needed as AI usage in health increases
Clear laws needed as AI usage in health increases

RNZ News

timea day ago

  • RNZ News

Clear laws needed as AI usage in health increases

A digtal health expert says Aotearoa needs clear laws on the use of artifical intelligence, including what information and data can be fed into model, and whats off limits, as AI is increasingly used in health and other areas. Associate Minister of Health, David Seymour has written to Pharmac encouraging them to use Articficial Intelligence to speed up their processes and improve access to medicines. Medsafe and Pharmac say they've started using Artificial intelligence tools to process complex information and large data sets. AUT Associate Professor and expert in digital health Sam Madanian spoke to Lisa Owen. To embed this content on your own webpage, cut and paste the following: See terms of use.

AI and cloud growth demands smarter security for SMBs
AI and cloud growth demands smarter security for SMBs

Techday NZ

timea day ago

  • Techday NZ

AI and cloud growth demands smarter security for SMBs

Cloud and AI are accelerating business transformation across the Asia Pacific, offering new ways for SMBs to scale, innovate and stay competitive. But growth brings complexity, and right now many businesses are flying blind when it comes to securing what they're building. The power of AI is undisputable, from automation to sharper customer insights, AI has become foundational to business strategy. According to Forrester's report 'The Future of Operations', commissioned by Crayon in early 2025, 61% of APAC SMBs plan to implement or expand AI within the next two years. Those already investing are seeing results: they're 20% more likely to report revenue growth of 15% or more. But with this opportunity comes pressure. The same technologies enabling growth are also exposing critical infrastructure, data, and processes to risk. Security and privacy are now the top IT priority for 76% of SMBs, and 74% cite compliance as a key driver of AI investment. While AI is undoubtably fueling innovation and market expansion, the flip side is a sharp increase in cybersecurity challenges that businesses can't afford to ignore. A gap between strategy and security AI has also become a key force in enhancing cybersecurity measures across APAC, particularly in areas like threat detection and response. But while benefits are clear, many businesses, especially SMBs, are struggling to put the right guardrails in place. The challenge is clear: many SMBs are ambitious, but not always equipped. Nearly half face difficulties preparing data for AI workloads, and over 40% report persistent performance issues - including managing computing, storage, and networking infrastructure. The result? Slower progress, rising costs, and widening exposure. These aren't just technical gaps. They reflect a strategic misalignment between innovation and readiness. And too often, organisations are still relying on outdated systems and fragmented security frameworks while adopting cutting-edge technologies. As AI becomes embedded into every layer of business, cyber risks become systemic. Alert fatigue, false positives, and blind trust in black-box AI systems all chip away at resilience. And when systems fail, the cost isn't just financial, it's reputational, operational, and regulatory. Securing smart growth The truth is too many businesses are still navigating these changes without the clarity or confidence they need. Security can't be an afterthought. It must be lifecycle-led, integrated into every stage of cloud and AI adoption, with an honest conversation at the start. What are the vulnerabilities across your data, identities, applications and devices? Where do you need visibility? What does risk actually look like for your business model? Then comes a risk-informed plan that aligns with local regulations, embeds trust in every decision, and adapts as threats evolve. Workforces are hybrid, infrastructures are distributed, and data lives everywhere. That's why today's security models need to take on a 'Zero Trust' approach assuming nothing and verifying everything. APAC, where stakes are high In a region like the Asia Pacific, where cybersecurity regulations are tightening fast – such as the upcoming Cyber Security Act and Malaysia and progressive legislature in Singapore - aligning AI adoption with national standards is essential. Businesses that build security into their AI roadmap from the start are the ones best positioned to scale safely and competitively. The promise of AI and cloud growth is immense, but so are the stakes. For SMBs, success means walking the line between innovation and risk with a clear strategy and the right partners. With the right mindset, models, and partner support, businesses can harness the power of AI - securely, sustainably, and competitively.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store