rOi8MddlZddlmZddlmZddlmZddlmZm Z m Z m Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZmZdd lmZdd lmZddlmZddlm Z m!Z!ddl"m#Z#Gdde!Z$GddZ%y)N) defaultdict)deepcopy)get_all_start_methods)IterableAnyTypeget_args) BaseModel)models)INFERENCE_OBJECT_TYPES)InspectorEmbed)Embedder) NumericVectorNumericVectorStruct)ModelSchemaParser) FieldPath) FastEmbedMisc)ParallelWorkerPoolWorker) iter_batchcjeZdZdedefdZedededdfdZdee eefdee eeffdZ y) ModelEmbedderWorker batch_sizekwargsc 2tdi||_||_y)N) ModelEmbeddermodel_embedderr)selfrrs i/volume1/homes/robertsu/coba/app/.venv/lib/python3.12/site-packages/qdrant_client/embed/model_embedder.py__init__zModelEmbedderWorker.__init__s+5f5$returnc |dd|d|S)N)threadsrrr)clsrrs r startzModelEmbedderWorker.starts>1>v>>r"itemsc#K|D]9\}}|t|jj||jf;yw)Ninference_batch_size)listrembed_models_batchr)rr)idxbatchs r processzModelEmbedderWorker.processsKJC''::DOO;  sAAN) __name__ __module__ __qualname__intrr! classmethodr(rtupler1rr"r rrsl%3%#%?s?c?6K?? XeCHo6 8E#s(O;T r"rcxeZdZdZ ddedzdedefdZ ddee ezded e d e efd Z dde e e efezd e d e dzd e e e efezfd Z ddee e efezdede d e efdZ dde e efezdeedzdedede dzd e e efe e efzezezej(zf dZdej,d dfdZ d dej,dede d eej(zfdZddede d dfdZde d eej(zfdZdej,d ej,fdZed eefdZ y)!r@Nparser is_local_moderc i|_i|_t||_| |_t j |_tdd|ji||_ y)N)r: use_core_bm25r) _batch_accumulator_embed_storager _embed_inspector_is_builtin_embedder_availabler is_installed_fastembed_availablerembedder)rr:r;rs r r!zModelEmbedder.__init__-sZ LNVX .f =2?.?+$1$>$>$@! ]t/R/R]V\] r" raw_modelsis_queryrr#c#K|jstjt|tr|g}t ||D]}|j |||Ed{ y7w)a2Embed raw data fields in models and return models with vectors If any of model fields required inference, a deepcopy of a model with computed embeddings is returned, otherwise returns original models. Args: raw_models: Iterable[BaseModel] - models which can contain fields with raw data is_query: bool - flag to determine which embed method to use. Defaults to False. batch_size: int - batch size for inference Returns: list[BaseModel]: models with embedded fields r+N)rArimport_fastembed isinstancer rr.)rrErFrraw_models_batchs r embed_modelszModelEmbedder.embed_models:sj"22  * * , j) ,$J *:z B .. (/  !C sAA&A$A&parallelc#K|jstjd}t|trt ||krd}||dk(s|r-t ||D]}|j||Ed{yd}t ||}|dk(rtj}dtvrdnd }|Jt||j||j } | j|| D] }|Ed{y77 w) a1Embed raw data fields in models and return models with vectors Requires every input sequences element to contain raw data fields to inference. Does not accept ready vectors. Args: raw_models: Iterable[BaseModel] - models which contain fields with raw data to inference batch_size: int - batch size for inference parallel: int - number of parallel processes to use. Defaults to None. Returns: Iterable[Union[dict[str, BaseModel], BaseModel]]: models with embedded fields FTNr%r+)sizer forkserverspawn) num_workersworker start_methodmax_internal_batch_size)r)rArrHrIr-lenrr.os cpu_countrr_get_worker_classMAX_INTERNAL_BATCH_SIZE ordered_map) rrErrLis_smallr0multiprocessing_batch_sizeraw_models_batchesrSpools r embed_models_strictz!ModelEmbedder.embed_models_strictUs&22  * * , j$ ':+  x1}#J ;225z2ZZZ<*+ &!+J=W!X 1}<<>+7;P;R+Rz3ModelEmbedder.embed_models_batch..s9",I ##%!&)= $ ",s")rArrHrdr>)rrErFr,rfs` `` r r.z ModelEmbedder.embed_models_batchsu"22  * * ,#I    H4  P$&&! ! !",   " s$A A2A.A2(A0)A20A2modelpathsrac t|ttr1|r|j|n|Jd|j |||S||s t |n|}t|t rJ|jD]5\}}|r|j||d|j|||d|||<7|S||n|jj|}|D]}t|ts|gn|} | D]} t| |jd} | |jr!|j| |j|||Jt| t} | r| n| g} |s_|Jd| D cgc]} |j | ||}} | rt| |j|t| |j|d| D]} |j| |Scc} w) abEmbed model's fields requiring inference Args: model: Qdrant http model containing fields to embed paths: Path to fields to embed. E.g. [FieldPath(current="recommend", tail=[FieldPath(current="negative", tail=None)])] is_query: Flag to determine which embed method to use. Defaults to False. accumulating: Flag to determine if we are accumulating models for batch embedding. Defaults to False. inference_batch_size: Optional[int] - batch size for inference Returns: A deepcopy of the method with embedded fields Nz3inference_batch_size should be passed for inferencerFr,T)raFrcr)rIr r _accumulate_drain_accumulatorrdictr)rdr@inspectr-getattrcurrenttailsetattr)rrhrirFrar,keyvaluepath list_modelitem current_modelwas_listdata embeddingss r rdzModelEmbedder._process_models$6 eX&<= >  ')4IHI4..%)=/ =+7HUOUE eT "#kkm U''u4'H!%!4!4!)%*-A "5"E#J ,L*0E0E0M0Me0TD(25$(?%UJ" 'dllD A  (99''% !)%1-A ( *->H5=MM?M'0<QPQ< )6 &)6!33 $xNb4)6 #& $#D$,, C#D$,, 1 F$1D ,,T2%2?#F &s!Gr{ct|tr'|jD]}|j|yt|tr3|D].}t|t t sy|j|0t|t t sy|j|}|j|jvrg|j|j<|j|jj|y)aHAdd data to batch accumulator Args: data: models.VectorStruct - any vector struct data, if inference object types instances in `data` - add them to the accumulator, otherwise - do nothing. `InferenceObject` instances are converted to proper types. Returns: None N) rIrnvaluesrlr-r r _resolve_inference_objectrhr>append)rr{rus r rlzModelEmbedder._accumulate s dD !  '' dD !!%2H)IJ  ' $)? @A--d3 ::T44 424D # #DJJ /  +2248r"c,t|tr1|jD]\}}|j|||||<|St|trIt |D]9\}}t|t ts|cS|j|||||<;|St|t ts|S|jr&|jj|jds|j|||j|jS)atDrain accumulator and replaces inference objects with computed embeddings It is assumed objects are traversed in the same order as they were added to the accumulator Args: data: models.VectorStruct - any vector struct data, if inference object types instances in `data` - replace them with computed embeddings. If embeddings haven't yet been computed - compute them and then replace inference objects. inference_batch_size: int - batch size for inference Returns: NumericVectorStruct: data with replaced inference objects rkN) rIrnr)rmr- enumerater r r?getrh_embed_accumulator _next_embed)rr{rFr,rtruis r rmz ModelEmbedder._drain_accumulator+s dD !"jjl U 33HCW4S +K dD !%dO5!%2H)IJK11HCW2Q ,K (12 K""$*=*=*A*A$**d*S  # #XL` # a ++r"c dttdtdtdtttt j zffd }jD]}tjj|jj|jj|jj|jj|frt|djj!D]\}}||||j"|<jj%y) aEmbed all accumulated objects for all models Args: is_query: bool - flag to determine which embed method to use. Defaults to False. inference_batch_size: int - batch size for inference Returns: None objects model_namerr#c g}g}g}tt}t|D]\}}t|tj } tt ||D]_\} \} } | |jk(s| | k(s|| j||| j| r |jn |j|g|t|<|j|j|j| |j| r |jn |jgg} tt ||D]X\}\} } | jjj|| r||nd| s||nd| xsi|Dcgc]}|c}Zt| }ggt|z}|j!D]}|D]}t#|||<|Scc}w)a, Assemble batches by options and data type based groups, embeds and return embeddings in the original order. If models.Document model is bm25 and Qdrant version is 1.15.3 or higher, return the document without changes to be processed by Qdrant itself. N)rtextsimagesrFoptionsr)rr-rrIr DocumentziprrtextimagerUextendrDembediterr~next)rrrunique_optionsunique_options_is_textbatches group_indicesrobjis_textjroptions_is_textr| embeddingiter_embeddingsordered_embeddingsindicesindexrFrs r rz/ModelEmbedder._embed_accumulator..embed_s46N13 "!#G2=d2CM#G,3$S&//:5>(>?61A1#++-'_2L%a(//2 ))g#((399M 6;<M#n"56"))#++6*11':NNCHHSYY#GH- J)23~G]3^)_%%GW!!*.)<)<'107'!*T5<71:$%-$+Mr'1 *=* *I"*  *`#:.O=?D3w<anyrDis_supported_text_modelis_supported_sparse_model(is_supported_late_interaction_text_modelis_supported_image_model.is_supported_late_interaction_multimodal_model ValueErrorr)r?clear)rrFr,rrhr{s`` r rz ModelEmbedder._embed_accumulatorUs,2 &012 &?B2 &PS2 & - 4#8 82 &h,,EMM99%@MM;;EBMMJJ5QMM::5AMMPPQVW !gst- 2288:KE4).;O*D   &; %%'r"rc>|j|jdS)zGet next computed embedding from embedded batch Args: model_name: str - retrieve embedding from the storage by this model name Returns: NumericVector | models.Document : computed embedding r)r?pop)rrs r rzModelEmbedder._next_embeds "":.22155r"c8t|tjs|S|j}|j}|j }t |jj||jj||jj|frtj|||S|jj|rtj|||S|jj|rt|dt|d)aResolve inference object into a model Args: data: models.VectorStruct - data to resolve, if it's an inference object, convert it to a proper type, otherwise - keep unchanged Returns: models.VectorStruct: resolved data )rhrr)rhrrz- does not support `InferenceObject` interfacez is not among supported models)rIr InferenceObjectrhobjectrrrDrrrrrImagerr)rr{rrurs r rz'ModelEmbedder._resolve_inference_objects$ 6 67KZZ  ,,  55jA 77 C FFzR  ??%Q Q == 1 1* =<2!2!* 2! $sI~&2 3 2!n$% "c9n- 9:""" " )  "N)-"+/ ^CN#i/^I%^ ^  ^ "Dj ^ S)^ sM! " #     //  ^@ 3 3>VW(,''(,37(,OR(, v .(,TQ(4Q(sQ([_Q(f 6c 6mfoo.M 6Hf.A.AHfFYFYH@#$':";##r"r)&rV collectionsrcopyrmultiprocessingrtypingrrrr pydanticr qdrant_client.httpr qdrant_client.embed.commonr #qdrant_client.embed.embed_inspectorr qdrant_client.embed.embedderrqdrant_client.embed.modelsrr!qdrant_client.embed.schema_parserrqdrant_client.embed.utilsrqdrant_client.fastembed_commonr qdrant_client.parallel_processorrrqdrant_client.uploader.uploaderrrrrr"r rsP #100%=>1I?/8G6&*k#k#r"