Creating ChatUI space for trained model
Hi, I’m getting an error while creating a space for chatUI, please provide some suggestion to solve this, or solution.===== Application Startup at 2023-10-17 12:30:41 =====2023-10-17T12:33:17.305992Z  INFO text_generation_launcher: Args { model_id: “ravivishwakarmauzio/hpeb-9ypo-tvfb-0”, revision: None, validation_workers: 2, sharded: None, num_shard: Some(1), quantize: None, dtype: None, trust_remote_code: true, max_concurrent_requests: 128, max_best_of: 2, max_stop_sequences: 4, max_top_n_tokens: 5, max_input_length: 1024, max_total_tokens: 2048, waiting_served_ratio: 1.2, max_batch_prefill_tokens: 4096, max_batch_total_tokens: None, max_waiting_tokens: 20, hostname: “s-ravivishwakarmauzio-chatuziogpt–ui-32d0f-7cb9ccc8cd-vrb8h”, port: 8080, shard_uds_path: “/tmp/text-generation-server”, master_addr: “localhost”, master_port: 29500, huggingface_hub_cache: Some(“/data”), weights_cache_override: None, disable_custom_kernels: false, cuda_memory_fraction: 1.0, rope_scaling: None, rope_factor: None, json_output: false, otlp_endpoint: None, cors_allow_origin:, watermark_gamma: None, watermark_delta: None, ngrok: false, ngrok_authtoken: None, ngrok_edge: None, env: false }2023-10-17T12:33:17.306197Z  WARN text_generation_launcher:trust_remote_codeis set. Trusting that modelravivishwakarmauzio/hpeb-9ypo-tvfb-0do not contain malicious code.2023-10-17T12:33:17.306329Z  INFO download: text_generation_launcher: Starting download process.% Total    % Received % Xferd  Average Speed   Time    Time     Time  CurrentDload  Upload   Total   Spent    Left  Speed0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 60Warning: retries left.{“t”:{“$date”:“2023-10-17T14:33:17.326+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:23285,   “ctx”:“-”,“msg”:“Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols ‘none’”}{“t”:{“$date”:“2023-10-17T14:33:17.326+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4915701, “ctx”:“main”,“msg”:“Initialized wire specification”,“attr”:{“spec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:6,“maxWireVersion”:17},“isInternalClient”:true}}}{“t”:{“$date”:“2023-10-17T14:33:17.327+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4648601, “ctx”:“main”,“msg”:“Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.”}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationDonorService”,“namespace”:“config.tenantMigrationDonors”}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationRecipientService”,“namespace”:“config.tenantMigrationRecipients”}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“ShardSplitDonorService”,“namespace”:“config.tenantSplitDonors”}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:5945603, “ctx”:“main”,“msg”:“Multi threading initialized”}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:4615611, “ctx”:“initandlisten”,“msg”:“MongoDB starting”,“attr”:{“pid”:6,“port”:27017,“dbPath”:“/data/db”,“architecture”:“64-bit”,“host”:“s-ravivishwakarmauzio-chatuziogpt–ui-32d0f-7cb9ccc8cd-vrb8h”}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“W”,  “c”:“CONTROL”,  “id”:20720,   “ctx”:“initandlisten”,“msg”:“Memory available to mongo process is less than total system memory”,“attr”:{“availableMemSizeMB”:14336,“systemMemSizeMB”:15823}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:23403,   “ctx”:“initandlisten”,“msg”:“Build Info”,“attr”:{“buildInfo”:{“version”:“6.0.11”,“gitVersion”:“f797f841eaf1759c770271ae00c88b92b2766eed”,“openSSLVersion”:“OpenSSL 1.1.1f  31 Mar 2020”,“modules”:,“allocator”:“tcmalloc”,“environment”:{“distmod”:“ubuntu2004”,“distarch”:“x86_64”,“target_arch”:“x86_64”}}}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:51765,   “ctx”:“initandlisten”,“msg”:“Operating System”,“attr”:{“os”:{“name”:“Ubuntu”,“version”:“20.04”}}}{“t”:{“$date”:“2023-10-17T14:33:17.328+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:21951,   “ctx”:“initandlisten”,“msg”:“Options set by command line”,“attr”:{“options”:{}}}{“t”:{“$date”:“2023-10-17T14:33:17.329+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:22315,   “ctx”:“initandlisten”,“msg”:“Opening WiredTiger”,“attr”:{“config”:“create,cache_size=6656M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,remove=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=2000),statistics_log=(wait=0),json_output=(error,message),verbose=[recovery_progress:1,checkpoint_progress:1,compact_progress:1,backup:0,checkpoint:0,compact:0,evict:0,history_store:0,recovery:0,rts:0,salvage:0,tiered:0,timestamp:0,transaction:0,verify:0,log:0],”}}{“t”:{“$date”:“2023-10-17T14:33:18.165+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:4795906, “ctx”:“initandlisten”,“msg”:“WiredTiger opened”,“attr”:{“durationMillis”:836}}{“t”:{“$date”:“2023-10-17T14:33:18.165+02:00”},“s”:“I”,  “c”:“RECOVERY”, “id”:23987,   “ctx”:“initandlisten”,“msg”:“WiredTiger recoveryTimestamp”,“attr”:{“recoveryTimestamp”:{“$timestamp”:{“t”:0,“i”:0}}}}{“t”:{“$date”:“2023-10-17T14:33:18.360+02:00”},“s”:“W”,  “c”:“CONTROL”,  “id”:22120,   “ctx”:“initandlisten”,“msg”:“Access control is not enabled for the database. Read and write access to data and configuration is unrestricted”,“tags”:[“startupWarnings”]}{“t”:{“$date”:“2023-10-17T14:33:18.360+02:00”},“s”:“W”,  “c”:“CONTROL”,  “id”:22140,   “ctx”:“initandlisten”,“msg”:“This server is bound to localhost. Remote systems will be unable to connect to this server. Start the server with --bind_ip  to specify which IP addresses it should serve responses from, or with --bind_ip_all to bind to all interfaces. If this behavior is desired, start the server with --bind_ip 127.0.0.1 to disable this warning”,“tags”:[“startupWarnings”]}{“t”:{“$date”:“2023-10-17T14:33:18.360+02:00”},“s”:“W”,  “c”:“CONTROL”,  “id”:5123300, “ctx”:“initandlisten”,“msg”:“vm.max_map_count is too low”,“attr”:{“currentValue”:524288,“recommendedMinimum”:1677720,“maxConns”:838860},“tags”:[“startupWarnings”]}{“t”:{“$date”:“2023-10-17T14:33:18.360+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:20320,   “ctx”:“initandlisten”,“msg”:“createCollection”,“attr”:{“namespace”:“admin.system.version”,“uuidDisposition”:“provided”,“uuid”:{“uuid”:{“$uuid”:“00c84ecd-1267-4e8f-9387-5aea82488fdc”}},“options”:{“uuid”:{“$uuid”:“00c84ecd-1267-4e8f-9387-5aea82488fdc”}}}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“INDEX”,    “id”:20345,   “ctx”:“initandlisten”,“msg”:“Index build: done building”,“attr”:{“buildUUID”:null,“collectionUUID”:{“uuid”:{“$uuid”:“00c84ecd-1267-4e8f-9387-5aea82488fdc”}},“namespace”:“admin.system.version”,“index”:“id”,“ident”:“index-1–6314326179096885933”,“collectionIdent”:“collection-0–6314326179096885933”,“commitTimestamp”:null}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:20459,   “ctx”:“initandlisten”,“msg”:“Setting featureCompatibilityVersion”,“attr”:{“newVersion”:“6.0”}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5853300, “ctx”:“initandlisten”,“msg”:“current featureCompatibilityVersion value”,“attr”:{“featureCompatibilityVersion”:“6.0”,“context”:“setFCV”}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4915702, “ctx”:“initandlisten”,“msg”:“Updated wire specification”,“attr”:{“oldSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:6,“maxWireVersion”:17},“isInternalClient”:true},“newSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:17,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:17,“maxWireVersion”:17},“isInternalClient”:true}}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4915702, “ctx”:“initandlisten”,“msg”:“Updated wire specification”,“attr”:{“oldSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:17,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:17,“maxWireVersion”:17},“isInternalClient”:true},“newSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:17,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:17,“maxWireVersion”:17},“isInternalClient”:true}}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5853300, “ctx”:“initandlisten”,“msg”:“current featureCompatibilityVersion value”,“attr”:{“featureCompatibilityVersion”:“6.0”,“context”:“startup”}}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:5071100, “ctx”:“initandlisten”,“msg”:“Clearing temp directory”}{“t”:{“$date”:“2023-10-17T14:33:18.396+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:20536,   “ctx”:“initandlisten”,“msg”:“Flow Control is enabled on this deployment”}{“t”:{“$date”:“2023-10-17T14:33:18.397+02:00”},“s”:“I”,  “c”:“FTDC”,     “id”:20625,   “ctx”:“initandlisten”,“msg”:“Initializing full-time diagnostic data capture”,“attr”:{“dataDirectory”:“/data/db/diagnostic.data”}}{“t”:{“$date”:“2023-10-17T14:33:18.399+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:20320,   “ctx”:“initandlisten”,“msg”:“createCollection”,“attr”:{“namespace”:“local.startup_log”,“uuidDisposition”:“generated”,“uuid”:{“uuid”:{“$uuid”:“7675838c-c2b6-438d-b1c9-5b9650974ccd”}},“options”:{“capped”:true,“size”:10485760}}}{“t”:{“$date”:“2023-10-17T14:33:18.444+02:00”},“s”:“I”,  “c”:“INDEX”,    “id”:20345,   “ctx”:“initandlisten”,“msg”:“Index build: done building”,“attr”:{“buildUUID”:null,“collectionUUID”:{“uuid”:{“$uuid”:“7675838c-c2b6-438d-b1c9-5b9650974ccd”}},“namespace”:“local.startup_log”,“index”:“id”,“ident”:“index-3–6314326179096885933”,“collectionIdent”:“collection-2–6314326179096885933”,“commitTimestamp”:null}}{“t”:{“$date”:“2023-10-17T14:33:18.444+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:6015317, “ctx”:“initandlisten”,“msg”:“Setting new configuration state”,“attr”:{“newState”:“ConfigReplicationDisabled”,“oldState”:“ConfigPreStart”}}{“t”:{“$date”:“2023-10-17T14:33:18.444+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:22262,   “ctx”:“initandlisten”,“msg”:“Timestamp monitor starting”}{“t”:{“$date”:“2023-10-17T14:33:18.445+02:00”},“s”:“I”,  “c”:“STORAGE”,  “id”:20320,   “ctx”:“LogicalSessionCacheRefresh”,“msg”:“createCollection”,“attr”:{“namespace”:“config.system.sessions”,“uuidDisposition”:“generated”,“uuid”:{“uuid”:{“$uuid”:“81bb7799-dc6f-4d59-836e-f1af8ac3f151”}},“options”:{}}}{“t”:{“$date”:“2023-10-17T14:33:18.446+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:20712,   “ctx”:“LogicalSessionCacheReap”,“msg”:“Sessions collection is not set up; waiting until next sessions reap interval”,“attr”:{“error”:“NamespaceNotFound: config.system.sessions does not exist”}}{“t”:{“$date”:“2023-10-17T14:33:18.446+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:23015,   “ctx”:“listener”,“msg”:“Listening on”,“attr”:{“address”:“/tmp/mongodb-27017.sock”}}{“t”:{“$date”:“2023-10-17T14:33:18.446+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:23015,   “ctx”:“listener”,“msg”:“Listening on”,“attr”:{“address”:“127.0.0.1”}}{“t”:{“$date”:“2023-10-17T14:33:18.446+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:23016,   “ctx”:“listener”,“msg”:“Waiting for connections”,“attr”:{“port”:27017,“ssl”:“off”}}{“t”:{“$date”:“2023-10-17T14:33:18.551+02:00”},“s”:“I”,  “c”:“INDEX”,    “id”:20345,   “ctx”:“LogicalSessionCacheRefresh”,“msg”:“Index build: done building”,“attr”:{“buildUUID”:null,“collectionUUID”:{“uuid”:{“$uuid”:“81bb7799-dc6f-4d59-836e-f1af8ac3f151”}},“namespace”:“config.system.sessions”,“index”:“id”,“ident”:“index-5–6314326179096885933”,“collectionIdent”:“collection-4–6314326179096885933”,“commitTimestamp”:null}}{“t”:{“$date”:“2023-10-17T14:33:18.551+02:00”},“s”:“I”,  “c”:“INDEX”,    “id”:20345,   “ctx”:“LogicalSessionCacheRefresh”,“msg”:“Index build: done building”,“attr”:{“buildUUID”:null,“collectionUUID”:{“uuid”:{“$uuid”:“81bb7799-dc6f-4d59-836e-f1af8ac3f151”}},“namespace”:“config.system.sessions”,“index”:“lsidTTLIndex”,“ident”:“index-6–6314326179096885933”,“collectionIdent”:“collection-4–6314326179096885933”,“commitTimestamp”:null}}{“t”:{“$date”:“2023-10-17T14:33:18.551+02:00”},“s”:“I”,  “c”:“COMMAND”,  “id”:51803,   “ctx”:“LogicalSessionCacheRefresh”,“msg”:“Slow query”,“attr”:{“type”:“command”,“ns”:“config.system.sessions”,“command”:{“createIndexes”:“system.sessions”,“v”:2,“indexes”:[{“key”:{“lastUse”:1},“name”:“lsidTTLIndex”,“expireAfterSeconds”:1800}],“ignoreUnknownIndexOptions”:false,“writeConcern”:{},“$db”:“config”},“numYields”:0,“reslen”:114,“locks”:{“ParallelBatchWriterMode”:{“acquireCount”:{“r”:5}},“FeatureCompatibilityVersion”:{“acquireCount”:{“r”:5,“w”:1}},“ReplicationStateTransition”:{“acquireCount”:{“w”:5}},“Global”:{“acquireCount”:{“r”:5,“w”:1}},“Database”:{“acquireCount”:{“r”:4,“w”:1}},“Collection”:{“acquireCount”:{“r”:5,“w”:1}},“Mutex”:{“acquireCount”:{“r”:8}}},“storage”:{},“protocol”:“op_msg”,“durationMillis”:105}}Error: DownloadError2023-10-17T12:33:20.612648Z ERROR download: text_generation_launcher: Download encountered an error: The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by callingtransformers.utils.move_cache().0it [00:00, ?it/s]0it [00:00, ?it/s]Traceback (most recent call last):File “/opt/conda/lib/python3.9/site-packages/huggingface_hub/utils/_errors.py”, line 261, in REDACTED_TOKEN_for_statusresponse.raise_for_status()File “/opt/conda/lib/python3.9/site-packages/requests/models.py”, line 1021, in raise_for_statusraise HTTPError(http_error_msg, response=self)requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url:https://huggingface.co/api/models/ravivishwakarmauzio/hpeb-9ypo-tvfb-0The above exception was the direct cause of the following exception:Traceback (most recent call last):File “/opt/conda/bin/text-generation-server”, line 8, insys.exit(app())File “/opt/conda/lib/python3.9/site-packages/text_generation_server/cli.py”, line 115, in download_weightsutils.weight_files(model_id, revision, extension)File “/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/hub.py”, line 96, in weight_filesfilenames = weight_hub_files(model_id, revision, extension)File “/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/hub.py”, line 25, in weight_hub_filesinfo = api.model_info(model_id, revision=revision)File “/opt/conda/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py”, line 118, in _inner_fnreturn fn(*args, **kwargs)File “/opt/conda/lib/python3.9/site-packages/huggingface_hub/REDACTED_TOKEN.py”, line 1678, in model_infoREDACTED_TOKEN_for_status(r)File “/opt/conda/lib/python3.9/site-packages/huggingface_hub/utils/_errors.py”, line 293, in REDACTED_TOKEN_for_statusraise RepositoryNotFoundError(message, response) from ehuggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-652e7f10-60238fd22f3106951619a2de;59e7ca43-9710-43f8-b601-fe2329cd0eaf)Repository Not Found for url:https://huggingface.co/api/models/ravivishwakarmauzio/hpeb-9ypo-tvfb-0.Please make sure you specified the correctrepo_idandrepo_type.If you are trying to access a private or gated repo, make sure you are authenticated.Invalid username or password.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 59Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 58Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 57Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 56Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 55Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 54Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 53Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0
2023-10-18T22:28:29Z
HI@ravivishwakarmauzioIt looks like your model is private, have you setHUGGING_FACE_HUB_TOKENon your Space?github.comGitHub - huggingface/chat-ui: Open source codebase powering the HuggingChat appmainOpen source codebase powering the HuggingChat app. Contribute to huggingface/chat-ui development by creating an account on GitHub.
2023-10-19T08:04:40Z
@radamesThanks for Providing suggestions. As per your suggestion.  I have made the model Public and addedHUGGING_FACE_HUB_TOKENto my space. But still getting some error, i have provided the log,and I’m using docker with chat UI template for space===== Application Startup at 2023-10-19 07:41:05 =====2023-10-19T07:44:17.356365Z  INFO text_generation_launcher: Args { model_id: “ravivishwakarmauzio/trainedModelwithAlpaca”, revision: None, validation_workers: 2, sharded: None, num_shard: Some(1), quantize: None, dtype: None, trust_remote_code: true, max_concurrent_requests: 128, max_best_of: 2, max_stop_sequences: 4, max_top_n_tokens: 5, max_input_length: 1024, max_total_tokens: 2048, waiting_served_ratio: 1.2, max_batch_prefill_tokens: 4096, max_batch_total_tokens: None, max_waiting_tokens: 20, hostname: “s-ravivishwakarmauzio-chatiuiforuzio-6b605-6cfc5c75cc-tkft8”, port: 8080, shard_uds_path: “/tmp/text-generation-server”, master_addr: “localhost”, master_port: 29500, huggingface_hub_cache: Some(“/data”), weights_cache_override: None, disable_custom_kernels: false, cuda_memory_fraction: 1.0, rope_scaling: None, rope_factor: None, json_output: false, otlp_endpoint: None, cors_allow_origin:, watermark_gamma: None, watermark_delta: None, ngrok: false, ngrok_authtoken: None, ngrok_edge: None, env: false }2023-10-19T07:44:17.356410Z  WARN text_generation_launcher:trust_remote_codeis set. Trusting that modelravivishwakarmauzio/trainedModelwithAlpacado not contain malicious code.2023-10-19T07:44:17.356487Z  INFO download: text_generation_launcher: Starting download process.% Total    % Received % Xferd  Average Speed   Time    Time     Time  CurrentDload  Upload   Total   Spent    Left  Speed0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 60Warning: retries left.{“t”:{“$date”:“2023-10-19T09:44:17.374+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4915701, “ctx”:“-”,“msg”:“Initialized wire specification”,“attr”:{“spec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:6,“maxWireVersion”:17},“isInternalClient”:true}}}{“t”:{“$date”:“2023-10-19T09:44:17.375+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:23285,   “ctx”:“-”,“msg”:“Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols ‘none’”}{“t”:{“$date”:“2023-10-19T09:44:17.375+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4648601, “ctx”:“main”,“msg”:“Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.”}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationDonorService”,“namespace”:“config.tenantMigrationDonors”}}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationRecipientService”,“namespace”:“config.tenantMigrationRecipients”}}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“ShardSplitDonorService”,“namespace”:“config.tenantSplitDonors”}}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:5945603, “ctx”:“main”,“msg”:“Multi threading initialized”}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:4615611, “ctx”:“initandlisten”,“msg”:“MongoDB starting”,“attr”:{“pid”:6,“port”:27017,“dbPath”:“/data/db”,“architecture”:“64-bit”,“host”:“s-ravivishwakarmauzio-chatiuiforuzio-6b605-6cfc5c75cc-tkft8”}}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“W”,  “c”:“CONTROL”,  “id”:20720,   “ctx”:“initandlisten”,“msg”:“Memory available to mongo process is less than total system memory”,“attr”:{“availableMemSizeMB”:14336,“systemMemSizeMB”:15823}}{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:23403,   “ctx”:“initandlisten”,“msg”:“Build Info”,“attr”:{“buildInfo”:{“version”:“6.0.11”,“gitVersion”:“f797f841eaf1759c770271ae00c88b92b2766eed”,“openSSLVersion”:“OpenSSL 1.1.1f  31 Mar 2020”,“modules”:,“allocator”:“tcmalloc”,“environment”:{“distmod”:“ubuntu2004”,“distarch”:“x86_64”,“target_arch”:“x86_64”}}}}{“t”:{“$date”:“2023-10-19T09:44:17.377+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:51765,   “ctx”:“initandlisten”,“msg”:“Operating System”,“attr”:{“os”:{“name”:“Ubuntu”,“version”:“20.04”}}}{“t”:{“$date”:“2023-10-19T09:44:17.377+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:21951,   “ctx”:“initandlisten”,“msg”:“Options set by command line”,“attr”:{“options”:{}}}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“E”,  “c”:“CONTROL”,  “id”:20557,   “ctx”:“initandlisten”,“msg”:“DBException in initAndListen, terminating”,“attr”:{“error”:“NonExistentPath: Data directory /data/db not found. Create the missing directory or specify another path using (1) the --dbpath command line option, or (2) by adding the ‘storage.dbPath’ option in the configuration file.”}}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:4784900, “ctx”:“initandlisten”,“msg”:“Stepping down the ReplicationCoordinator for shutdown”,“attr”:{“waitTimeMillis”:15000}}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“REPL”,     “id”:4794602, “ctx”:“initandlisten”,“msg”:“Attempting to enter quiesce mode”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“-”,        “id”:6371601, “ctx”:“initandlisten”,“msg”:“Shutting down the FLE Crud thread pool”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“COMMAND”,  “id”:4784901, “ctx”:“initandlisten”,“msg”:“Shutting down the MirrorMaestro”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“SHARDING”, “id”:4784902, “ctx”:“initandlisten”,“msg”:“Shutting down the WaitForMajorityService”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:20562,   “ctx”:“initandlisten”,“msg”:“Shutdown: going to close listening sockets”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4784905, “ctx”:“initandlisten”,“msg”:“Shutting down the global connection pool”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:4784906, “ctx”:“initandlisten”,“msg”:“Shutting down the FlowControlTicketholder”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“-”,        “id”:20520,   “ctx”:“initandlisten”,“msg”:“Stopping further Flow Control ticket acquisitions.”}{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”,  “c”:“NETWORK”,  “id”:4784918, “ctx”:“initandlisten”,“msg”:“Shutting down the ReplicaSetMonitor”}{“t”:{“$date”:“2023-10-19T09:44:17.379+02:00”},“s”:“I”,  “c”:“SHARDING”, “id”:4784921, “ctx”:“initandlisten”,“msg”:“Shutting down the MigrationUtilExecutor”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“ASIO”,     “id”:22582,   “ctx”:“MigrationUtil-TaskExecutor”,“msg”:“Killing all outstanding egress activity.”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“COMMAND”,  “id”:4784923, “ctx”:“initandlisten”,“msg”:“Shutting down the ServiceEntryPoint”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:4784928, “ctx”:“initandlisten”,“msg”:“Shutting down the TTL monitor”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:6278511, “ctx”:“initandlisten”,“msg”:“Shutting down the Change Stream Expired Pre-images Remover”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:4784929, “ctx”:“initandlisten”,“msg”:“Acquiring the global lock for shutdown”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“-”,        “id”:4784931, “ctx”:“initandlisten”,“msg”:“Dropping the scope cache for shutdown”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:20565,   “ctx”:“initandlisten”,“msg”:“Now exiting”}{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”,  “c”:“CONTROL”,  “id”:23138,   “ctx”:“initandlisten”,“msg”:“Shutting down”,“attr”:{“exitCode”:100}}2023-10-19T07:44:19.997664Z  INFO text_generation_launcher: Peft model detected.2023-10-19T07:44:19.997730Z  INFO text_generation_launcher: Loading the model it might take a while without feedback0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 59Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 58Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 57Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 56Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 55Warning: retries left.2023-10-19T07:45:17.018846Z  INFO text_generation_launcher: Loaded.2023-10-19T07:45:17.018904Z  INFO text_generation_launcher: Merging the lora weights.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 54Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 53Warning: retries left.Error: DownloadError2023-10-19T07:45:31.701740Z ERROR download: text_generation_launcher: Download encountered an error:Downloading shards:   0%|          | 0/2 [00:00<?, ?it/s]Downloading shards:  50%|█████     | 1/2 [00:26<00:26, 26.61s/it]Downloading shards: 100%|██████████| 2/2 [00:36<00:00, 16.91s/it]Downloading shards: 100%|██████████| 2/2 [00:36<00:00, 18.36s/it]Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]Loading checkpoint shards:  50%|█████     | 1/2 [00:04<00:04,  4.79s/it]Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00,  3.02s/it]Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00,  3.28s/it]Traceback (most recent call last):File “/opt/conda/bin/text-generation-server”, line 8, insys.exit(app())File “/opt/conda/lib/python3.9/site-packages/text_generation_server/cli.py”, line 131, in download_weightsutils.download_and_unload_peft(File “/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/peft.py”, line 38, in download_and_unload_peftos.makedirs(model_id, exist_ok=True)File “/opt/conda/lib/python3.9/os.py”, line 215, in makedirsmakedirs(head, exist_ok=exist_ok)File “/opt/conda/lib/python3.9/os.py”, line 225, in makedirsmkdir(name, mode)PermissionError: [Errno 13] Permission denied: ‘ravivishwakarmauzio’0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 52Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 51Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 50Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 49Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 48Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 47Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 46Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 45Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 44Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 43Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 42Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 41Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 40Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 39Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 38Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will retry in 10 seconds. 37Warning: retries left.0     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     00     0    0     0    0     0      0      0 --:–:-- --:–:-- --:–:--     0curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refusedWarning: Transient problem: connection refused Will r
2023-10-25T19:40:02Z
ravivishwakarmauzio:PermissionError: [Errno 13] Permission denied: ‘ravivishwakarmauzio’Getting the same error.  Of course mine includes my user name instead.Seems to be a permissions issue with accessing my user info?  But the space is within my user profile isn’t it?
2023-10-26T21:41:35Z
maybe@nsarrazincan help here?
2023-11-22T19:44:55Z
Same error here!
2023-12-17T16:09:48Z
Same error hereAny solutions yet?
2024-03-07T15:49:11Z
Same error here. Any news?
2024-04-22T18:48:06Z
Has anyone at all managed to fix this? I’ve made sure there’s both a HF_TOKEN and a HUGGING_FACE_HUB_TOKEN in my Space Secrets. I’ve made sure there’s a .env.local file too. Still running into this same issue with this:PermissionError: [Errno 13] Permission denied: ‘[my username]’Any ideas?