• Create
    • Ask a question
    • Create an article
    • Topics
    • Questions
    • Articles
    • Users
    • Badges
  • Sign in
  • Home /
avatar image
0

download URL for databricks /FileStore contents not working. will CLI work if i used community edition?

sparknotebooksfilestore
Question by buildlackey · Sep 13, 2018 at 02:02 AM ·

Note: this question was originally posted on stack overflow:>

https://stackoverflow.com/questions/52286157/download-url-for-databricks-filestore-contents-not-working-will-cli-work-if-i

I am experimenting w/ the Databricks cloud deployed Spark service. I created some data and would like to download it to my machine rather than lose it. This post: https://stackoverflow.com/questions/49019706/databricks-download-a-dbfs-filestore-file-to-my-local-machine/49021261#49021261 suggested going to the URL -> https://community.cloud.databricks.com/files whilst logged in to databricks (I am using community edition by the way).

So, I tried that URL and I got back a plain text document with the content "1". That was not so useful. So, I then looked up the instructions for using the Databricks CLI, and according to this page -> https://docs.databricks.com/api/latest/authentication.html#token-management I need to set up a personal access token, which I generate by clicking on the 'Access Tokens' tab of Account Settings screen. However, I found no 'Access Tokens' tab.

So, I'm wondering:

  • can I use the Databricks CLI to download the files I created (or is this only available for paid users) ?
  • if it is possible to use the CLI, then how do I generate an access token ?
  • If the CLI is not the way to go, then what is the proper URL to use to view the FileStore contents ?

Just for completeness sake, I will note that when I did an 'ls' of /FileStore, I found that folder to be non-empty:

    %fs  ls /FileStore/
      dbfs:/FileStore/chris.txt       chris.txt       20044
      dbfs:/FileStore/tables/
                etc etc..

Add comment
Comment
10 |600 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Sort

  • Votes
  • Created
  • Oldest

Your answer

Hint: You can notify a user about this post by typing @username

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Follow this Question

29 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

Does scheduling a spark job to run every day in Databricks start up the Spark cluster automatically? 1 Answer

Can't determine cause of spark driver crash 2 Answers

Is string interpolation supported as part of %run command 1 Answer

Connecting Spark to CosmosDB - Entity with the specified id does not exist in the system. 0 Answers

Notebook failing only on the first run 2 Answers

  • Product
    • Databricks Cloud
    • FAQ
  • Spark
    • About Spark
    • Developer Resources
    • Community + Events
  • Services
    • Certification
    • Spark Support
    • Spark Training
  • Company
    • About Us
    • Team
    • News
    • Contact
  • Careers
  • Blog

Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105

info@databricks.com
1-866-330-0121

  • Twitter
  • LinkedIn
  • Facebook
  • Facebook

© Databricks 2015. All rights reserved. Apache Spark and the Apache Spark Logo are trademarks of the Apache Software Foundation.

  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Create an article
  • Explore
  • Topics
  • Questions
  • Articles
  • Users
  • Badges