How to Set Up Dakota Marketplace Data in Databricks

How to Set Up Dakota Marketplace Data in Databricks
5:02

Data sourced from Dakota Marketplace, the global LP and GP intelligence platform trusted by thousands of investment professionals. Learn More | Book a Demo

Getting Dakota Marketplace data into Databricks takes two steps on your side and no code. Our 250,000+ allocator accounts and 386,000+ verified contacts arrive in your workspace as a private share through Delta Sharing, mounted as a catalog and ready to query next to your own data.

There’s no ETL pipeline to build, no files to transfer, and no developers to pull off other projects. You send us one identifier, we configure the share, and you mount it.

In this article, we’ll walk through what you need before you start, how to find and send your Sharing ID, what we do on our end, and how to access Dakota data once it’s live.

Before You Start

Your Databricks workspace needs to be enabled for Unity Catalog. Delta Sharing runs through Unity Catalog, and your administrator will use it to control who can access the Dakota catalog once it’s set up.

It also helps to decide two things up front:

  • What data you need. We tailor every private share to your firm. If your team only cares about RIAs, for example, you can receive just RIA accounts and contacts, and nothing else.
  • Who should have access. Know which users or groups at your firm will work with the data, so we can set the share up for the right people from day one.

Step 1: Find and Send Your Sharing ID

Your Sharing ID is the unique identifier for your Unity Catalog metastore. It’s not a username, password, or Databricks account ID, and it’s the only thing we need from you to set up the share.

To find it:

  1. Log in to your Databricks workspace.

  2. Click Catalog in the left sidebar.

  3. At the top of the Catalog pane, click the gear icon.

  4. Select OpenSharing from the dropdown.

  5. In the top-right corner of the OpenSharing page, find Sharing ID next to Settings. Click it to copy your ID to your clipboard.

  6. Paste your Sharing ID into an email and send it securely to the Dakota team, along with the users or groups who should have access.

What We Do on Our End

Once we receive your Sharing ID, our team:

  • Configures the Delta Share using your Sharing ID
  • Scopes the dataset to the accounts and contacts your firm needs
  • Grants your Databricks environment access to the share
  • Confirms with you when the data is ready

Want to talk through what your share should include before you send your Sharing ID? Book a demo with our team.

Step 2: Mount the Dakota Catalog

When we confirm your share is ready, mounting it takes a few clicks:

  1. In Databricks, click Catalog in the left sidebar.

  2. Click Shares received. This opens a page listing everything shared with your organization.

  3. Find the share named DAKOTA and click on it.

  4. Click Create catalog (or Mount a catalog), give it any name you like, and confirm.

  5. Open your new catalog to find the Account and Contact data, ready to query and read-only.

After Setup: Putting the Data to Work

Once the catalog is mounted, your Databricks administrator can grant access to the right internal users or groups. From there, your team queries Dakota data like any other table, in SQL, Python, or notebooks.

The shared data is read-only, so the source stays exactly as we deliver it. The best practice is to join it to your own tables, such as your CRM records and fundraising history, and write any enriched results to catalogs your firm owns.

If your analytics team works in Snowflake, the same private share model is available there too. See how our Snowflake integration works.

Frequently Asked Questions

What do I need in Databricks before setting up Dakota data?

Your workspace needs Unity Catalog enabled. Delta Sharing runs through Unity Catalog, and your administrator uses it to manage access to the Dakota catalog.

What is a Databricks Sharing ID?

It’s the unique identifier for your Unity Catalog metastore. You’ll find it on the OpenSharing page in Catalog. It’s not a username, password, or account ID.

Do I need developers to set this up?

No. You copy your Sharing ID, send it to us, and mount the share as a catalog once it’s ready. Unlike our API, there’s no custom code involved.

What data will I see in the Dakota catalog?

Account and Contact data, scoped to what your firm needs through your private share. The data is read-only and ready to query.

Is Dakota data available in Snowflake too?

Yes. We offer the same private share model in Snowflake, and many of the largest firms run both platforms.

Get Dakota Marketplace Data Into Your Databricks Workspace

Dakota Marketplace’s 250,000+ allocator accounts and 386,000+ verified contacts can be live in your Databricks workspace in two steps. Scope your share to the allocator types, geographies, and contacts your team targets, then query it next to your own fundraising data.

Ready to set up Dakota data in Databricks? Book a demo.

Morgan Holycross, Marketing Manager

Written By: Morgan Holycross, Marketing Manager

Morgan Holycross is a Marketing Manager at Dakota.