Datasets

Data Browser: Datasets

The Dataset Browser allows users to explore and manage datasets they are authorized to access. Access permissions are granted either due to the data being public or through lab-based, user-based, or collaborative access authorized by a Principal Investigator (PI).

The Data Browser is composed of different areas:

• A Navigation Bar on the left hand side allows users to quickly navigate between All Datasets, All Public Datasets, Knowledgebase Datasets, and My and Lab Data. Note that users who are not authenticated with an NMRhub account only see All Public Data and Knowledgebase Datasets. The My and Lab Data has sub-headings for additional hierarchal organization as described below.
• A Table view for visualizing the datasets as rows with a series of metadata columns that are all sortable and filterable
• Customization tools in the upper right hand corner for selecting saved views, quick filters, changing which metadata columns are displayed, creating and deleting views, and the ability to clear filters to columns that are displayed and hidden.
• A Upload Datasets button to allow users to upload datasets collected on NAN connected instruments that were not harvested by NDTS

Navigation Bar

All Datasets

Displays every dataset the user can access, including both public datasets and restricted datasets the user has permission to view through lab permissions or collaboration

All Public Datasets

Displays only datasets that have been marked as public, regardless of any user-specific permissions.

Knowledgebase Datasets

Displays a curated subset of public datasets designated as *Knowledgebase (KB) datasets*.

KB datasets are well-vetted, highly annotated datasets intended to aid users in running their own experiments and analyses.

My & Lab Data (Default View)

Displays datasets the user can view based on their PI-granted permissions.

*Excludes* datasets that are visible *only* because they are public.

If a dataset is public but the user would have had permission to see it regardless, it remains visible here.

Hierarchical Organization under My & Lab Data

The My & Lab Data section organizes user-accessible datasets hierarchically:

• My Collections
  • Personal collections created and managed by the user.
• Projects
  • High-level organizational units defined by the lab.
  • Studies
    • Subsets of Projects, grouping datasets for specific investigations.
    • Collections
      • Fine-grained dataset groupings within a Study.

This structure mirrors a traditional file system hierarchy: Project → Studies → Collections

Table of Datasets

The Dataset Table displays all the datasets that the user has at least read access. The datasets are shown as a table with user adjustable columns representing metadata associated with the datasets.

Display Name/ Dataset Name

While the user may control which metadata columns are visible, and in which order, the Display Name column is fixed as the first column. The Display Name is automatically set to the Dataset Name which is not-editable and is defined as the experimental directory name when the data was collected. For VNMRJ it is the expN directory name and for Bruker it is the experiment/N directory. The Display Name is user editable allowing the user to create a more meaningful name than the VNMRJ or Topspin software allows, while keeping the original Dataset Name fixed. When a user downloads an experiment, it will be saved using the Dataset Name (original experiment name), but the corresponding Display Name is saved in a CSV file located in the downloaded experiment’s folder.

---

How to customize the Datasets Table view

To customize the view of the Datasets Table

1. Click on the "Wrench" Icon in the top-right corner of the table
2. Click on the "Displayed Columns" button and select which columns you want to be visible in the Datasets Table
3. Click the "Save View" button
   • The saved views can be edited and deleted
4. The user can create multiple views
   • To switch between different views click on the "Saved Views" button

---

How to download experiments

To download experiments

1. Navigate to the Datasets section of the Data Browser
2. Locate the experiments you want to download
3. Click the "Checkbox" icon to select multiple experiments.
   • Alternatively, right-click on a single experiment to automatically select it
4. Right-click and select "Download" option form the context menu
5. Choose data organization format:
   • Organized for Topspin
     • If the datasets are in Bruker format you can download it structured for Topspin
     • The Topspin hierarchy of the data, including all folders/subfolders, will be preserved
   • Organized by experiment
     • Each experiment will be in a separate folder

---

How to link datasets to a sample

There are two ways of linking datasets to a sample.

1. Through editing the dataset
   • Double click on the dataset that you have write access to
   • In the appeared pop-up window, click on "Find & Link Sample"
   • Choose the sample from the table of available samples
   • Click "Save" to confirm the link
2. Through Datasets Table
   • Select one or more experiments you wish to link to a sample
   • Right-click and choose "Link sample" option form the context menu
   • Choose the sample from the table of available samples
   • Click "Save" to confirm the link

---

Quick Filters

Quick filters are predefined views that allows users to quickly access specific datasets. The user can apply one or more filters:

• Successful Datasets Only – displays datasets classified as successful
  • To classify a dataset, right-click on it and select "Classification" from the context menu

• Hide Failed Datasets – hides datasets that were classified as failed

• Non-Redundant Datasets – displays datasets marked as preferred
  • To mark a dataset as preferred/redundant, right-click on it and select "Redundancy" from the context menu

• My Data – displays datasets owned by the logged-in user

• Non-public Data – displays datasets that have not been made public
• KB Datasets - display datasets that have been published in a knowledgebase

---

Context menu

Right-clicking on a dataset opens the Context menu which provides various actions that users can perform on the selected dataset. The available options depend on the user's permissions for that dataset, options that are not allowed will appear grayed out. The options might include:

1. Edit Dataset
   • Change basic information about the dataset
   • Mark dataset as preferred/redundant
2. Reassign
   • Reassign dataset to another user within the lab
   • Reject misaligned data
     • User has three months to reject the data
     • The rejected data are automatically assigned to the facility manager of the facility in which the dataset was collected
3. Download - download selected datasets
4. NMRbox Integration - copy the dataset to NMRbox
5. Supplemental Data - upload supplemental data
6. Redundancy - mark a dataset as preferred/redundant
7. Link Sample - link the dataset to the sample that has been created in the Samples section of the Data Browser
   • Name of the sample and a link to its information will appear in the Sample Column of Datasets Table
8. Classification - classify dateset as
   • Calibration experiment
   • Failed - sample related
   • Failed - instrument related
   • Failed - setup related
   • Succesful Experiment
   • Test experiment

1. Tags - assign tags to categorize the dataset
2. Notes - add or update dataset notes
3. Unlink from Collection - if the dataset is linked to a Dataset Collection, the user can unlink it
4. Make Public - make the dataset public. This is a PERMANENT option and can't be undone.
5. Publish - publish dataset. The published datasets can't be edited. This is a PERMANENT option and can't be undone.