Is your data AI-ready? That was a consistent theme at this year’s Gartner Data & Analytics Summit in Orlando, Florida. There were many Gartner keynotes and analyst-led sessions that had titles like: “Scale Data and Analytics on Your AI Journeys” “What Everyone in D&A Needs to Know About (Generative) AI: The Foundations” “AI Governance: Design […]
Groups Step Up to Rescue At-Risk Public Data
(shuttersev/Shutterstock) Public data is the lifeblood of open research and scientific inquiry. But the possibility of losing public datasets–including academic, government, and scientific data generated as part of research–is now spurring several groups to take action to save it. In early February, the New York Times reported that more than 8,000 Web pages had been […]
Introducing Serverless Batch Inference | Databricks Blog
Generative AI is transforming how organizations interact with their data, and batch LLM processing has quickly become one of Databricks’ most popular use cases. Last year, we launched the first version of AI Functions to enable enterprises to apply LLMs to private data—without data movement or governance trade-offs. Since then, thousands of organizations have powered […]
Nested Fields in Elasticsearch: Why and How to Avoid Them
The Nested field type in Elasticsearch and OpenSearch is not as innocent as one would think. Let’s look at what they are used for, the challenges with them, and possible alternatives. Elasticsearch is a document-oriented data store. Trying to use relational models like in-use in RDBMS systems like Postgresql and MySQL, with Elasticsearch is prone […]
How to optimize service order management in telecommunications?
In the growing telecommunications sector, effective management of service requests is becoming important to maintain quality service and customer satisfaction. Operators have to deal with a huge number of requests – from standard installations to complex network repairs. How to optimize this process to improve operational efficiency and increase customer satisfaction? The answer is a […]
2024 at Atlan: A Love Letter to the Humans of Data 💌 – Atlan
This Valentine’s Season, we’re reflecting on all our dreams that came to life in 2024 and want to take a moment to celebrate the people who make those dreams real—the humans of data. 💙 At the heart of Atlan’s story is a wall—our dream wall. Since our earliest days, it’s been a tradition where our […]
Architect fault-tolerant applications with instance fleets on Amazon EMR on EC2
Organizations rely on Amazon EMR on EC2 clusters to process large-scale data workloads using frameworks like Apache Spark, Apache Hive, and Trino. Events such as TV advertisements or unplanned promotions might lead to an increase in demand of compute capacity, making effective capacity planning necessary to make sure your workloads don’t hit capacity limits or […]
Palantir and Databricks Announce AI Product Partnership
SAN FRANCISCO, March 13, 2025 — Databricks and Palantir Technologies Inc. (NASDAQ: PLTR), provider of enterprise operating systems, today announced a strategic product partnership that combines Palantir’s AI operating system and Databricks’ platform for AI, data warehousing and data engineering. The partnership will provide an open and scalable data architecture that combines Palantir’s powerful Ontology System with Databricks’ processing scale and […]
The best Alexa smart speaker I’ve tested isn’t an Echo (and it’s 20% off)
ZDNET’s key takeaways The Sonos Era 100 is a $249 smart speaker that I recommend to most people, audiophile or not. In addition to a full, booming sound, the Sonos speaker produces crystal-clear vocals that enhance any song and has hands-free Alexa for voice control. Since the Era 100 is built for smaller spaces, it […]
How AWS DEA-C01 Helps You Become a Data Engineer?
This blog covers how the AWS Certified Data Engineer Associate Certification is a game-changer for aspiring data engineers. It also explains the growing importance of data in the digital age and how the DEA-C01 is a valuable credential that demonstrates your expertise in designing, building, and maintaining data processing systems on the AWS cloud. Understanding […]