Loading…
This layer is editable and shared with the public. To prevent unwanted editing, unshare this item or approve it for public data collection.
Finish setting up your layer
Describe your item below. Add fields on the Data tab. Configure editing on the Settings tab. Configure drawing and pop-ups through Map Viewer or Visualization tab.
Open
Creating Service

Deep learning package to use Hugging Face Visual Question Answering models. A brief summary of the item is not available. Add a brief summary about the item.

‎Deep learning package by

New notebook runtime available. You can update the runtime from the settings tab of the item details page.

Item created: Dec 10, 2024 Item updated: Mar 1, 2025 Number of downloads: 69

Snapshot last refreshed:

1973 characters left.

Description

The HF Visual Question Answering deep learning package seamlessly integrates pre-trained Visual Question Answering (VQA) models from the Hugging Face Hub with ArcGIS, enabling you to utilize a variety of Hugging Face VQA models directly from ArcGIS. With this deep learning package, you can generate answers to open-ended questions, based on an image, using a pre-trained model designed to interpret and analyze visual data. The deep learning package is compatible with a wide range of Hugging Face models for VQA tasks.


Before running a model, ensure compliance with its licensing terms, which can be found on the Hugging Face model page. Run only trusted models, as they include weights and code that could impact system security. Since model sizes vary, ensure adequate CPU/GPU memory is available for inference. 


Using the model

Follow the guide to use the model. Before using this model, ensure that the supported deep learning libraries are installed. For more details, check Deep Learning Libraries Installer for ArcGIS. 


Fine-tuning the model
This model cannot be fine-tuned using ArcGIS tools.

Input
8-bit, 3-band imagery.

Output

Feature class with the generated response from the model.


Applicable geographies

The model is expected to work globally.


Model architecture

This deep learning package utilizes the model from the Hugging Face Visual Question Answering Models page, given the model ID.


Sample results
Here are a few results from the model.

huggingface_id: Salesforce/blip-vqa-base

prompt: 'What do you see in the image ?'

An in-depth description of the item is not available.

Layers

Ground Layers

Tools

Tables

Basemap

Project Contents:

Solution Contents

Contents

Layers

Screenshots

Terms of Use

https://downloads.esri.com/blogs/arcgisonline/esrilogo_new.png This work is licensed under the Esri Master License Agreement.

No special restrictions or limitations on using the item's content have been provided.

Comments (0)

Sign in to add a comment.
Item Information

LowHigh

Item Information

LowHigh

Make your item easy to find, understand, and use by providing this information.

    Details

    Dashboard views: Desktop

    Source: (Image Collection)

    Creating data in:

    Published as:

      Other Views:

        Dependent items in the recycle bin

          Applicable: 2d

          Size: 15.901 KB

          Attachments size: 0 KB

          ID: 439d0b0a183c49b2ad1bfba20c0cf72f

          Image Count: 0

          Image Properties

          Layer Drawing

          Using tiles from a cache

          Dynamically from data

          Share
          Owner

          esri_analytics

          Folder

          Categories

          This item has not been categorized.

          Assign Category
          Tags

          vqa, visual question answering, dlpk, deep learning package, hugging face, model runner, vision language

          Edit Tags
          Credits (Attribution)
          No acknowledgements.

          ArcGIS Navigator link
          URL View
          WMTS View
          Your tile layer is ready to use
          This tile layer will automatically create tiles as needed and cache them for future use. No further configuration is required. View the Settings tab to change the default options. Build tiles manually for specific scales and extents to improve display performance for the first person to view the tile layer at that scale and extent. Tiles must exist if the layer will be used offline.
          All items were exported successfully
          ${numberOfItems} item(s) were exported successfully. Some item(s) skipped or failed to export.
          See description for more information
          Cannot import
          Export packages from newer portal versions cannot be imported to older versions.
          Loading…