o d~#gA @s,UdZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZmZmZmZddlmZddlmZmZmZm Z m!Z!m"Z"d d l#m$Z$d d l%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+d d l,m-Z-m.Z.e rddl/m0Z0m1Z1ddl2m3Z3e4Z5ee4e fZ6ee7efZ8ee8e6e5fZ9ddhZ:e;e<Z=eGdddZ>ddZ?ddZ@ddZAdaBeee4ee4feCd<dee4ee4ffddZDdee dee fdd ZEed!e9dee8fd"d#ZFed!eddeedfd$d#ZFed!ee9deee8ddffd%d#ZFd!e9de4fd&d'ZGd(e4dd)fd*d+ZHd!e7defd,d-ZId!e7defd.d/ZJd!e7dd)fd0d1ZK 2d\d3ee4ee4e fe9fd4eee4e fd5eLdee4e ffd6d7ZMd8ee7d9eLdeee4ee.ffd:d;ZNd8ee7d9eLdeee4ee.ffde7d9eLdeee4e.ffd?d@ZPdAee7dee-fdBdCZQdAee7dee-fdDdEZRd>e7dee-fdFdGZSdHdIdJdKdee7fdLdMZTiZUeee4ee4feCdN<dOee4dPee4ddfdQdRZVdOee4dee4fdSdTZWdUedefdVdWZXdXee4dYee4de fdZd[ZYdS)]zEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError)ENDPOINT)build_hf_headers get_sessionhf_raise_for_statusis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImagez text-to-imagezimage-to-imagec@s2eZdZUdZeed<eed<eed<eed<dS) ModelStatusa This Dataclass represents the the model status in the Hugging Face Inference API. Args: loaded (`bool`): If the model is currently loaded into Hugging Face's InferenceAPI. Models are loaded on-demand, leading to the user's first request taking longer. If a model is loaded, you can be assured that it is in a healthy state. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig'. If a model's state is 'Loadable', it's not too big and has a supported backend. Loadable models are automatically loaded when the user first requests inference on the endpoint. This means it is transparent for the user to load a model, except that the first call takes longer to complete. compute_type (`Dict`): Information about the compute resource the model is using or will use, such as 'gpu' type and number of replicas. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. loadedstate compute_type frameworkN)__name__ __module__ __qualname____doc__bool__annotations__strr r5r5/var/www/static.ux5.de/https/Moving-Object-Detection-with-OpenCV/env/lib/python3.10/site-packages/huggingface_hub/inference/_common.pyr)Qs  r)cCststdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)r8r5r5r6_import_aiohttprr9cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)r r7numpy)r;r5r5r6 _import_numpy{r:r<cCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr')r!r7PILr(r'r5r5r6_import_pil_images  r>_RECOMMENDED_MODELSreturncCsBtdurtjtdtd}t|dd|DatS)Nz /api/tasks)headerscSsi|] \}}|t|dqS) widgetModels)_first_or_none).0taskdetailsr5r5r6 sz-_fetch_recommended_models..)r?rgetrrrjsonitems)responser5r5r6_fetch_recommended_modelss rLrJcCs$z|dpdWStyYdSw)Nr) IndexError)rJr5r5r6rCs  rCcontentcCdSNr5rNr5r5r6_open_as_binaryrRcCrOrPr5rQr5r5r6rRrSccst|tr2|ds|dr"td|t|jVdSt|}| s2t d|dt|trZtd|| d }|VWddS1sSwYdS|VdS) zOpen `content` as a binary file, either from a URL, a local path, or raw bytes. Do nothing if `content` is None, TODO: handle a PIL.Image as input TODO: handle base64 as input zhttps://zhttp://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rb) isinstancer4 startswithloggerdebugrrHrNrexistsFileNotFoundErroropen)rNfr5r5r6rRs"    " cCsPt|}t|tr |n|}t|WdS1s!wYdS)z[Encode a raw file (image, audio) into base64. Can be byes, an opened file, a path or a URL.N)rRrUbytesreadbase64 b64encodedecode)rNdata data_as_bytesr5r5r6 _b64_encodes  $rd encoded_imager(cCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)r>r[ioBytesIOr_ b64decode)rer(r5r5r6 _b64_to_imagesricCt|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rIloadsrarQr5r5r6_bytes_to_listrmcCrj)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rkrQr5r5r6_bytes_to_dictrnrocCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )r>r[rfrg)rNr(r5r5r6_bytes_to_imagesrpFinputs parameters expect_binarycCs|duri}dd|D}t|dk}t|ttf}|r,|s,t|ts,td||r4|s4d|iS|s?|r?td|i}|rJt||d<n||d<|rT||d <d |iS) a$ Used in `InferenceClient` and `AsyncInferenceClient` to prepare the payload for an API request, handling various input types and parameters. `expect_binary` is set to `True` when the inputs are a binary object or a local path or URL. This is the case for image and audio inputs. NcSsi|] \}}|dur||qSrPr5)rDkvr5r5r6rGsz$_prepare_payload..rz5Expected binary inputs or a local path or a URL. Got rbzUnexpected binary inputs. Got rqrrrI)rJlenrUr]rr4 ValueErrorrd)rqrrrshas_parameters is_binaryrIr5r5r6_prepare_payloads$  rzbytes_output_as_linesrFc csD|D]}zt||}Wn tyYdSw|dur|VqdS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationr{rF byte_payloadoutputr5r5r6 _stream_text_generation_response/s rc CsN|2z 3dHW}zt||}Wn tyYdSw|dur#|Vq6dS)z/Used in `AsyncInferenceClient.text_generation`.Nr|rr5r5r6&_async_stream_text_generation_response=s rrcCs~|dsdS|dkrtd|d}t|dd}|ddur2t |d|dt |}|s=|j j S|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8zdata:z/nerror error_type)rVstripr~rarIrllstriprstriprH_parse_text_generation_errorr$parse_obj_as_instancetokentext)rrFpayload json_payloadrr5r5r6r}Ks    r} bytes_linesc csB|D]}zt|}Wn tyYdSw|dur|VqdS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputr~ritemrr5r5r6 _stream_chat_completion_responseas  rc CsL|2z3dHW}zt|}Wn tyYdSw|dur"|Vq6dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrr5r5r6&_async_stream_chat_completion_responsens  rcCsn|dsdS|dkrtd|d}t|dd}|ddur2t |d|dt |Sr) rVrr~rarIrlrrrHrr#r)rrrr5r5r6r{s    rclientr&rKr%cCs4|j2z 3dHW}|Vq6|IdHdSrP)rNrclose)rrKrr5r5r6_async_yield_froms  r#_UNSUPPORTED_TEXT_GENERATION_KWARGSmodelunsupported_kwargscCst|g|dSrP)r setdefaultextend)rrr5r5r6'_set_unsupported_text_generation_kwargssrcCs t|gSrP)rrH)rr5r5r6'_get_unsupported_text_generation_kwargss r http_errorcCs^zt|ddp |j}|d}|d}Wn ty |w|dur-t||}|||)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. response_error_payloadNrr)getattrrKrIrH Exceptionr)rrrr exceptionr5r5r6raise_text_generation_errors    rrrcCsH|dkrt|S|dkrt|S|dkrt|S|dkr t|St|S)N generationincomplete_generation overloaded validation)rrrrr)rrr5r5r6rsr)F)Zr1r_rfrIlogging contextlibr dataclassesrpathlibrtypingrrrrr r r r r rrrrrrequestsrhuggingface_hub.errorsrrrrrr constantsrutilsrrrrr r!_generated.typesr#r$r8r%r& PIL.Imager(r4UrlTPathTr]BinaryTContentTTASKS_EXPECTING_IMAGES getLoggerr.rWr)r9r<r>r?r3rLrCrRrdrirmrorpr2rzrrr}rrrrrrrrrr5r5r5r6s   @               &    )         "