sOijddlmZddlmZddlmZmZmZddlm Z ddl m Z ddl m Z ddlmZddlmZdd lmZmZdd lmZdd lmZdd lmZ dde j8dede j<ezde de jBd zde jDd zde jFde$de d zde$fdZ%GddeZ&y ))count)sleep)Any GeneratorIterable)uuid4)grpc)models)ResourceExhaustedResponse) get_channel) RestToGrpcpayload_to_grpc) BaseUploader) show_warning) common_typesN points_clientcollection_namebatch max_retriesshard_key_selector update_filter update_modewaittimeoutreturnc |\} } } | dtDn| } | dtDn| } t| | | D cgc]m\} } }tjt | tj st j| n| t j| t|xsio}} } }d}||kr/ |jtj||||||| yycc}} } w#t$r?}td|jdtd t!|jYd}~nAd}~wt"$r2}td |d zd td ||d z k(r||d z }Yd}~nd}~wwxYw||kr)Nc3jK|]+}tjtt-yw))uuidN)r PointIdstrr.0_s k/volume1/homes/robertsu/coba/app/.venv/lib/python3.12/site-packages/qdrant_client/uploader/grpc_uploader.py z$upload_batch_grpc..s#:'Q3uw< ( ('s13c3 K|]}dywNr!s r$r%z$upload_batch_grpc..!s+7aT7s )idvectorspayloadr)rpointsrrrr)rz3Batch upload failed due to rate limit. Waiting for z seconds before retrying...)messagecategory stacklevelzBatch upload failed z times. Retrying...T)rzipr PointStruct isinstancerr convert_extended_point_idconvert_vector_structrUpsert UpsertPointsr r retry_after_s UserWarningr Exception)rrrrrrrrr ids_batch vectors_batch payload_batchidxvectorr+r,attemptexes r$upload_batch_grpcrDs/4+I}m?H>O:%':U^0=/D+57+-M%( =-$P %Q C c4<<033C844V<#GMr2  %Q G K    !!$3!'9"/ +   !  ( [ 4) $ MbN^N^M__z{$  """ # #  .w{m;NO$  +/) qLG - K s+A2C/,C66 E7?5D99 E7(E22E7ceZdZ ddedededededejdzdejdzd ejdzd e fd Z e ddedzdededed e d df d Z dee d eeddffdZdee d eefdZy)GrpcBatchUploaderNhostportrrrrrrkwargsc  ||_||_||_||_| |_||_|t j|nd|_| jdd|_ t|tjrt j|n||_t|tj rt j"||_y||_y)Nr)r_host_portr_kwargs_waitr convert_shard_key_selector_shard_key_selectorpop_timeoutr4restFilterconvert_filter_update_filter UpdateModeconvert_update_mode _update_mode) selfrGrHrrrrrrrIs r$__init__zGrpcBatchUploader.__init__Ts /  &  "-  1 12D E   9d3 -5  % %m 4 +t7  * *; 7  rc 6|s td|d||||d|S)Nz"Collection name could not be empty)rGrHrrr() RuntimeError)clsrrGrHrrIs r$startzGrpcBatchUploader.startws;CD D +#     r\itemsc #TKtd|j|jd|j}t j |}|D]^}t ||j||j|j|j|j|j|j `yw)N)rGrH)rrrrrrr()r rKrLrMr PointsStubrDrrPrVrYrrNrR)rZrachannelrrs r$process_uploadz GrpcBatchUploader.process_uploadsO4::DJJO$,,O0 E#$$#'#;#;"11 -- ,,ZZ   sB&B(c#BK|j|Ed{y7wr')re)rZras r$processzGrpcBatchUploader.processs&&u---s )FNNN)N localhosti)__name__ __module__ __qualname__r intbooltypesShardKeySelectorrTrWrr[ classmethodr`rrrergr(r\r$rFrFSs+<@-1/3! ! !  !  !  ! "22T9! ||d*! %%,! ! F'+  t           &HSMidD@P6Q .Xc].x~.r\rF)NFN)' itertoolsrtimertypingrrrrr qdrant_clientr r rS&qdrant_client.common.client_exceptionsr qdrant_client.connectionr $qdrant_client.conversions.conversionr rqdrant_client.uploader.uploaderr$qdrant_client.common.client_warningsrqdrant_client.conversionsrrorcr BatchtuplermrprTrWrnrDrFr(r\r$r~s++'(L0L8=;$(????? :: ? ? --4 ? ;;% ?? ?4Z? ?DI. I.r\