Using Claude Code (or any other agent) for data analysis on Databricks

TL;DR: Perform exploratory data analysis on Databricks by "volleying" with AI agents like Claude or Copilot - iterate quickly with SQL queries, and generate notebooks automatically. The indeterministic nature of LLMs is great for looking at patterns within datasets and although it may lead to false smoking guns many times, there will be times where you'll find stuff that you didn't notice earlier.…