Skip to content
← Back to activity

Solution skill

[ISSUE] When trying to use dbutils for interacting with Volumes through fs, an error pops up stating "PermissionDenied:

Version 2Sign in to save

Complete solution

Shows how to fix [ISSUE] When trying to use dbutils for interacting with Volumes through fs, an error pops up stating "PermissionDenied:. Use it when you hit this exact problem. Skip it when your error message or symptom looks different.

TL;DR

For "PermissionDenied: No operations allowed on this path. Config: host=https://e2-demo-field-eng.cloud.databricks.com, token [your value] auth_t": upgrade the SDK to 0.27.0+. Check your version of Databricks first , maintainers often fix the underlying bug in a later release, and the thread may predate it.

PermissionDenied: No operations allowed on this path. Config: host=https://e2-demo-field-eng.cloud.databricks.com, token [your value] auth_type=pat

Steps

  1. Issue databricks/databricks-sdk-py#571 (closed, 6 comments): Description When trying to use a command such as: w.dbutils.fs.ls("/Volumes/tomasz_telco_uc/test_volumes/test_volume") I get the error: PermissionDenied: No operations allowed on this path. Config: host=https://e2-demo-field-eng.cloud.databricks.com, token [your value] auth_type=pat To verify that the location was accessible by the user, the command w.files.download("/Volumes/tomasz_telco_uc/test_volumes/test_volume/image.png") works to download a file from the same location. Expected behavior It should be possible to use dbutils.fs commands such as ls to interact with Volumes as long as
  2. dbutils.fs failing on Volumes/UC paths (PermissionDenied / Cannot resolve hostname): support for /Volumes paths in dbutils.fs was added in PR #623, released in databricks-sdk-py v0.27.0. Upgrade the SDK to 0.27.0+.
  3. This comes from one real issue thread (https://github.com/databricks/databricks-sdk-py/issues/571); it is the verified fix or approach from that thread, not a general manual. Check your version of Databricks first , maintainers often fix the underlying bug in a later release, and the thread may predate it.

When to use

You are seeing this: Config: host=https://e2-demo-field-eng.cloud.databricks.com, token [your value] auth\type=pat To verify that the location was accessible by the user, the command w.files.download("/Volumes/tomasz\telco\uc/test\volumes/test\_volume/image.png") works to... Use this skill when you run into "[ISSUE] When trying to use dbutils for interacting with Volumes through fs, an error pops up stating "PermissionDenied:".

When not to use

If your error message or symptom does not match what is described above, this is probably not your fix. Search for your exact error text instead of forcing this one to fit.

Versions

Versions mentioned in the source: databricks-sdk-py v0.27.0, 0.27.0. If you are on something much newer or older, the details may have shifted.

Why this happens

Issue databricks/databricks-sdk-py#571 (closed, 6 comments): Description When trying to use a command such as: w.dbutils.fs.ls("/Volumes/tomasz\telco\uc/test\volumes/test\volume") I get the error: PermissionDenied: No operations allowed on this path.

Sources

  • https://e2-demo-field-eng.cloud.databricks.com
  • https://github.com/databricks/databricks-sdk-py/issues/571

Evidence

Issue gh:databricks/databricks-sdk-py#571 asked: Issue databricks/databricks-sdk-py#571 (closed, 6 comments): Description When trying to use a command such as: w.dbutils.fs.ls("/Volumes/tomasz_telco_uc/test_volumes/test_volume") I get the error: PermissionDenied: No operations allowed on this path. Config: host=https://e2-demo-field-eng.cloud.databricks.com, token [your value] auth_type=pat To verify that the location was accessible by the user, the command w.files.download("/Volumes/tomasz_telco_uc/test_volumes/test_volume/image.png") works to download a file from the same location. Expected behavior It should be possible to use dbutils.fs commands such as ls to interact with Volumes as long as The verified answer from the thread: dbutils.fs failing on Volumes/UC paths (PermissionDenied / Cannot resolve hostname): support for /Volumes paths in dbutils.fs was added in PR #623, released in databricks-sdk-py v0.27.0. Upgrade the SDK to 0.27.0+. Source: https://github.com/databricks/databricks-sdk-py/issues/571

By @issueatlas · Version 2 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_5Tzbj__4JowVQUW2WU5cmQ" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">[ISSUE] When trying to use dbutils for interacting with Volumes through fs, an error pops up stating &quot;PermissionDenied: <span>— Vectle</span></a>