DataGrip 2022.3 Help

Hive Metastore

With the Big Data Tools plugin, you can monitor your Hive Metastore.

Typical workflow:

  1. Establish connection to a Hive server

  2. Preview your storage in a File Viewer

  3. Preview your databases and partitions in a dedicated tool window

Create a connection to a Hive server

  1. In the Big Data Tools tool window, click Add a connection and select Hive Metastore under the Monitoring section.

  2. In the Big Data Tools Connections window that opens, configure the connection parameters:

    Configure Hive connection

    Mandatory parameters:

    • Name: the name of the connection to distinguish it between the other connections.

    • Properties: select how to specify your Hive configuration properties: enter them explicitly or load them from a configuration folder. If you select Explicit, you can enter a value for the metastore.thrift.uris property in the URL field and enter any other properties in the Other properties field.

    Optionally, you can set up:

    • Enable connection: deselect if you want to restrict using this connection. By default, the newly created connections are enabled.

    • Per project: select to enable these connection settings only for the current project. Deselect it if you want this connection to be visible in other projects.

    • Enable tunneling. Creates an SSH tunnel to the remote host. It can be useful if the target server is in a private network but an SSH connection to the host in the network is available.

      Select the checkbox and specify a configuration of an SSH connection (click ... to create a new SSH configuration).

    • Database pattern: if you want to view only some of your Hive databases in the editor tab, use this field to enter a regular expression for the database names.

    • Table pattern: if you want to view only some of your database tables in the editor tab, use this field to enter a regular expression for the table names.

  3. Once you fill in the settings, click Test connection to ensure that all configuration parameters are correct. Then click OK.

View databases in File Viewer

You can open the Hive Metastore or its particular catalogs, databases, and tables in a separate File Viewer (similarly to other storages).

  1. In the Big Data Tools tool window, select a Hive Metastore connection or expand it to open a catalog, a database, or a table.

  2. Right-click the selected element and select Open in Separate Viewer. Alternatively, click the File Viewer button.

    This will open the selected storage, catalog, database, or table in a separate tab of your editor.

  3. Right-click a database or a table and select Show Info. The information about the selected element will be displayed to the right of it. Use the Open Editor Preview button to show and hide the details panel.

Hive Metastore tab

Monitor databases

Once you have established a connection to the Hive server, the Hive Metastore tool window becomes available. You can use it to monitor your databases, view schemas and partitions, and configure the way the data is displayed:

  • Start typing a name in the Filter field to filter databases by name.

  • Click App general filter to filter data by storage type.

  • Click Show and hide columns icon to show or hide columns from the database view.

The Hive Metastore tool window

In the Location column, you can click the database URL to quickly open a directory in an HDFS or S3 viewer. If the needed connection does not exist, this will open the connection creation form.

Last modified: 05 December 2022