Server : LiteSpeed System : Linux barito.iixcp.rumahweb.net 5.14.0-611.49.1.el9_7.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 21 16:39:08 EDT 2026 x86_64 User : elvh3918 ( 1528) PHP Version : 8.2.31 Disable Function : mail Directory : /usr/local/lib/python3.9/site-packages/celery/backends/__pycache__/ |
a
��Sh� � @ s d Z ddlZddlZddlZddlmZ ddlmZ ddlm Z ddl
m Z ddl m
Z
ddlmZmZmZ dd lmZ dd
lmZmZ dd lmZ ddlZdd lmZm Z m Z m Z dd
l m Z ddl!m"Z" ddlm#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z* ddl+m,Z,m-Z-m.Z.m/Z/m0Z0 ddl1m2Z2 ddl3m4Z4m5Z5 ddl6m7Z7 ddl8m9Z9m:Z:m;Z;m<Z<m=Z= ddl>m?Z? dZ@eAdh�ZBe7eC�ZDdZEedd�ZFdZGd ZHd d � ZIG d d � d eJ�ZKd!d"� ZLG d#d$� d$�ZMG d%d&� d&�ZNG d'd(� d(eMeN�ZOeOZPG d)d*� d*eM�ZQG d+d,� d,eQeN�ZRG d-d.� d.eO�ZSdS )/z�Result backend base classes.
- :class:`BaseBackend` defines the interface.
- :class:`KeyValueStoreBackend` is a common base class
using K/V semantics like _get and _put.
� N)�
namedtuple)� timedelta)�partial)�WeakValueDictionary)�
ExceptionInfo)�dumps�loads�prepare_accept_content)�registry)� bytes_to_str� ensure_bytes)�maybe_sanitize_url)� current_app�group�maybe_signature�states)�get_current_task)�Context)�BackendGetMetaError�BackendStoreError�
ChordError�ImproperlyConfigured�
NotRegistered�
SecurityError�TaskRevokedError� TimeoutError)� GroupResult�
ResultBase� ResultSet�allow_join_result�result_from_tuple)� BufferMap)�LRUCache�
arity_greater)�
get_logger)�create_exception_cls�ensure_serializable�get_pickleable_exception�get_pickled_exception�raise_with_context)� get_exponential_backoff_interval)� BaseBackend�KeyValueStoreBackend�DisabledBackend�picklei �pending_results_t)Zconcrete�weakzU
No result backend is configured.
Please see the documentation for more information.
z�
Starting chords requires a result backend to be configured.
Note that a group chained with a task is also upgraded to be a chord,
as this pattern requires synchronization.
Result backends that supports chords: Redis, Database, Memcached, and more.
c C s | |dt �� i|��S )z Return an unpickled backend.�app)r Z_get_current_object)�cls�args�kwargs� r5 �>/usr/local/lib/python3.9/site-packages/celery/backends/base.py�unpickle_backend? s r7 c @ s e Zd Zdd� Ze Z ZZdS )� _nulldictc O s d S �Nr5 )�self�a�kwr5 r5 r6 �ignoreE s z_nulldict.ignoreN)�__name__�
__module__� __qualname__r= � __setitem__�update�
setdefaultr5 r5 r5 r6 r8 D s r8 c C s | d u r dS | j S �NF)Z
ignore_result��requestr5 r5 r6 �_is_request_ignore_resultK s rG c @ s* e Zd ZejZejZejZeZdZdZ dZ
dZ ddddd�Z dpdd �Z
dqd
d �Zd d
� Zddejfdd�Zddddejfdd�Zdd� Zdddejfdd�Zdddejfdd�Zdrdd�Zdsdd �Zdtd d �Zd d � Z d!d"� Z d#d$� Z d%d&� Z d'd(� Z d)d*� Z!d+d,� Z"dud-d.�Z#dvd/d0�Z$d1d2� Z%d3d4� Z&dwd5d6�Z'd7d8� Z(dxd9d:�Z)d;d<� Z*d=d>� Z+d?d@� Z,e,Z-dAdB� Z.dCdD� Z/dEdF� Z0dGdH� Z1dIdJ� Z2dydKdL�Z3dMdN� Z4dOdP� Z5dzdQdR�Z6d{dSdT�Z7dUdV� Z8dWdX� Z9dYdZ� Z:d[d\� Z;d]d^� Z<d_d`� Z=dadb� Z>dcdd� Z?d|dedf�Z@dgdh� ZAdidj� ZBd}dkdl�ZCd~dndo�ZDdS )�BackendNFT� r � )� max_retriesZinterval_startZ
interval_stepZ interval_maxc K s || _ | j j} |p| j| _tj| j \| _| _| _|p:| j }
|
dkrJt
� nt |
d�| _ | �
||�| _|d u rr| jn|| _| jd u r�| jn| j| _t| j�| _| �dd�| _| �dd�| _| �dd�| _| �d td
��| _| �d d�| _ti t� �| _ t t �| _ || _ d S ) N���)�limitZresult_backend_always_retryFZ+result_backend_max_sleep_between_retries_msi' Z,result_backend_base_sleep_between_retries_ms�
Zresult_backend_max_retries�infZresult_backend_thread_safe)!r1 �confZresult_serializer�
serializer�serializer_registryZ _encoders� content_type�content_encoding�encoderZresult_cache_maxr8 r" �_cache�prepare_expires�expiresZresult_accept_content�acceptZaccept_contentr �get� always_retry� max_sleep_between_retries_ms� base_sleep_between_retries_ms�floatrK Z thread_safer/ r Z_pending_resultsr! �MESSAGE_BUFFER_MAXZ_pending_messages�url) r: r1 rQ Zmax_cached_resultsrY rX Z expires_typer` r4 rP Zcmaxr5 r5 r6 �__init__o s*
�
zBackend.__init__c C s2 |r
| j S t| j pd�}|�d�r.|dd� S |S )z=Return the backend as an URI, sanitizing the password or not.� z:///NrL )r` r
�endswith)r: Zinclude_passwordr` r5 r5 r6 �as_uri� s zBackend.as_uric K s | � ||tj�S )zMark a task as started.)� store_resultr ZSTARTED�r: �task_id�metar5 r5 r6 �mark_as_started� s zBackend.mark_as_startedc C s: |r t |�s | j||||d� |r6|jr6| �|||� dS )z#Mark task as successfully executed.rE N)rG re �chord�on_chord_part_return)r: rg �resultrF re �stater5 r5 r6 � mark_as_done� s
zBackend.mark_as_donec C s� |r| j |||||d� |r�|jr0| �|||� zt|j�}W n ttfyZ t� }Y n0 |D ]z} t| �}
|
� |
j
� |
j
� d�|
_ |
j
� d�|
_
|r�|tjv r�|
jdur�| j |
j||||
d� d|
j
v r`| �|
||� q`|r�|jr�| �|||� dS )z#Mark task as executed with failure.�� tracebackrF rg �group_idNrj )re rj rk �iter�chain�AttributeError� TypeError�tupler rB �optionsrZ �idr r ZPROPAGATE_STATESrg �errbacks�_call_task_errbacks) r: rg �excrp rF re Z
call_errbacksrm Z
chain_dataZ
chain_elemZchain_elem_ctxr5 r5 r6 �mark_as_failure� s<
�
����
zBackend.mark_as_failurec C s� g }|j D ]�}| j�|�}|js(| j|_zDt|jd�r`t|jjt�s`t |jjd�r`||||� n
|�
|� W q
t y� |�
|� Y q
0 q
|r�|j }|j
p�|}t|| jd�}| jjjs�|j�dd�r�|j|f||d� n|j|f||d� d S )N�
__header__rJ �r1 Zis_eagerF)� parent_id�root_id)ry r1 � signatureZ_app�hasattr�type�
isinstancer} r r# �appendr rx r� r rP �task_always_eager�
delivery_inforZ �apply� apply_async) r: rF r{ rp Z
old_signatureZerrbackrg r� �gr5 r5 r6 rz � s6
�
� �
��zBackend._call_task_errbacksrb c C s< t |�}|r | j|||d |d� |r8|jr8| �|||� d S )Nro )r re rj rk )r: rg �reasonrF re rm r{ r5 r5 r6 �mark_as_revoked s
�
zBackend.mark_as_revokedc C s | j |||||d�S )zfMark task as being retries.
Note:
Stores the current exception (if any).
ro )re )r: rg r{ rp rF re rm r5 r5 r6 �
mark_as_retry s
�zBackend.mark_as_retryc
C s� | j }z|j|j j}W n ty. | }Y n0 t|j�d�|j�dg �t� d�|��}z| � ||d � W n4 t
y� } z |j |j |d�W Y d }~S d }~0 0 |j |j |d�S d S )Nrg Z
link_error)rx ry r� )r{ )
r1 Z_tasks�task�backend�KeyErrorr rw rZ �dictrz � Exception�fail_from_current_stackrx )r: �callbackr{ r1 r� Z fake_requestZeb_excr5 r5 r6 �chord_error_from_stack s"
��&z Backend.chord_error_from_stackc C s t �� \}}}z�|d u r |n|}t|||f�}| �|||j� |W |d ur|z|j�� |jj W n tyr Y n0 |j }qB~S |d ur�z|j�� |jj W n ty� Y n0 |j }q�~n>|d ur�z|j�� |jj W n ty� Y n0 |j }q�~0 d S r9 )
�sys�exc_infor r| rp �tb_frame�clear�f_locals� RuntimeError�tb_next)r: rg r{ �type_Zreal_exc�tbZexception_infor5 r5 r6 r� 2 s>
�
�
z Backend.fail_from_current_stackc C sL |du r| j n|}|tv r"t|�S t|�}t|d|j�t|j| j�|j d�S )z$Prepare exception for serialization.Nr@ )�exc_type� exc_message�
exc_module)
rQ �EXCEPTION_ABLE_CODECSr' r� �getattrr> r& r3 �encoder? )r: r{ rQ �exctyper5 r5 r6 �prepare_exceptionE s �zBackend.prepare_exceptionc
C s� |sdS t |t�r(| jtv r$t|�}|S t |t�stz t|�}W n4 tyr } z td|� ��|�W Y d}~n
d}~0 0 |�d�}z |d }W n. ty� } zt d�|�W Y d}~n
d}~0 0 |du r�t
|t �}nPz(t j
| }|�d�D ]}t||�}q�W n& ttf�y t
|tjj �}Y n0 |�dd�}t |t��rBt|t��sr|du �rP|n |� d|� �}td |� d
|� ���z&t |ttf��r�||� }n||�}W n: t�y� } z t|� d |� d ��}W Y d} ~ n
d} ~ 0 0 |S )
z1Convert serialized exception to Python exception.NzbIf the stored exception isn't an instance of BaseException, it must be a dictionary.
Instead got: r� r� z5Exception information must include the exception type�.r� rb z!Expected an exception class, got z with payload �(�))r� �
BaseExceptionrQ r� r( r� ru rZ r� �
ValueErrorr% r> r� �modules�splitr� rt �celery�
exceptionsr� �
issubclassr rv �listr� )
r: r{ �er� r� r2 �nameZexc_msgZ
fake_exc_type�errr5 r5 r6 �exception_to_pythonO s^
��
��
�
�
*zBackend.exception_to_pythonc C s | j dkr t|t�r |�� S |S )zPrepare value for storage.r. )rQ r� r �as_tuple�r: rl r5 r5 r6 �
prepare_value� s zBackend.prepare_valuec C s | � |�\}}}|S r9 )�_encode)r: �data�_�payloadr5 r5 r6 r� � s zBackend.encodec C s t || jd�S )N)rQ )r rQ )r: r� r5 r5 r6 r� � s zBackend._encodec C s$ |d | j v r | �|d �|d< |S )N�statusrl )�EXCEPTION_STATESr� )r: rh r5 r5 r6 �meta_from_decoded� s zBackend.meta_from_decodedc C s | � | �|��S r9 )r� �decode�r: r� r5 r5 r6 �
decode_result� s zBackend.decode_resultc C s. |d u r |S |pt |�}t|| j| j| jd�S )N)rS rT rY )�strr rS rT rY r� r5 r5 r6 r� � s �zBackend.decodec C s< |d u r| j jj}t|t�r$|�� }|d ur8|r8||�S |S r9 )r1 rP Zresult_expiresr� r �
total_seconds)r: �valuer� r5 r5 r6 rW � s
zBackend.prepare_expiresc C s( |d ur |S | j jj}|d u r$| jS |S r9 )r1 rP Zresult_persistent�
persistent)r: �enabledr� r5 r5 r6 �prepare_persistent� s
zBackend.prepare_persistentc C s( || j v r t|t�r | �|�S | �|�S r9 )r� r� r� r� r� )r: rl rm r5 r5 r6 �
encode_result� s
zBackend.encode_resultc C s
|| j v S r9 )rV �r: rg r5 r5 r6 � is_cached� s zBackend.is_cachedc C sH || j v r"| j�� }|r&|�� }nd }|||| �|�|d�}|rVt|dd �rV|j|d< |rpt|dd �rp|j|d< | jj� dd��rD|�rDt|dd �t|dd �t|d d �t|d
d �t|d d �t
|d �r�|j r�|j � d
�nd d�} t|dd ��r|j
| d< | �|j� |�r:dd h}
|
D ]$} | | } | �| �}
t|
�| | < �q|�| � |S )N)r� rl rp �children� date_doner rq r �extendedrl r� r3 r4 �hostname�retriesr� Z routing_key)r� r3 r4 Zworkerr� �queue�stamps�stamped_headers)� READY_STATESr1 �now� isoformat�current_task_childrenr� r r rP Zfind_value_for_keyr� r� rZ r� rB r� r� r )r: rl rm rp rF Z format_dater� r� rh Z request_metaZencode_needed_fields�fieldr� Z
encoded_valuer5 r5 r6 �_get_result_meta� sN
�
���
zBackend._get_result_metac C s t �|� d S r9 )�time�sleep)r: �amountr5 r5 r6 �_sleep� s zBackend._sleepc
K s� | � ||�}d}z"| j||||fd|i|�� |W S ty� } zf| jr�| �|�r�|| jk r�|d7 }t| j|| jd�d } | � | � q�t
t d||d�� n� W Y d}~qd}~0 0 qdS ) z�Update task state and result.
if always_retry_backend_operation is activated, in the event of a recoverable exception,
then retry operation with an exponential backoff until a limit has been reached.
r rF rJ T�� z%failed to store result on the backend)rg rm N) r� �
_store_resultr� r[ �exception_safe_to_retryrK r* r] r\ r� r) r )
r: rg rl rm rp rF r4 r� r{ � sleep_amountr5 r5 r6 re s0 ��
�� �zBackend.store_resultc C s | j �|d � | �|� d S r9 )rV �pop�_forgetr� r5 r5 r6 �forget# s zBackend.forgetc C s t d��d S )Nz"backend does not implement forget.��NotImplementedErrorr� r5 r5 r6 r� ' s zBackend._forgetc C s | � |�d S )zGet the state of a task.r� )�
get_task_metar� r5 r5 r6 � get_state* s zBackend.get_statec C s | � |��d�S )z$Get the traceback for a failed task.rp �r� rZ r� r5 r5 r6 �
get_traceback0 s zBackend.get_tracebackc C s | � |��d�S )zGet the result of a task.rl r� r� r5 r5 r6 �
get_result4 s zBackend.get_resultc C s( z| � |�d W S ty" Y n0 dS )z(Get the list of subtasks sent by a task.r� N)r� r� r� r5 r5 r6 � get_children8 s zBackend.get_childrenc C s$ | j jjr | j jjs t�dt� d S )Nz�Results are not stored in backend and should not be retrieved when task_always_eager is enabled, unless task_store_eager_result is enabled.)r1 rP r� Ztask_store_eager_result�warnings�warn�RuntimeWarning�r: r5 r5 r6 �_ensure_not_eager? s
�zBackend._ensure_not_eagerc C s dS )a Check if an exception is safe to retry.
Backends have to overload this method with correct predicates dealing with their exceptions.
By default no exception is safe to retry, it's up to backend implementation
to define which exceptions are safe.
Fr5 )r: r{ r5 r5 r6 r� G s z Backend.exception_safe_to_retryc
C s� | � � |r,z | j| W S ty* Y n0 d}z| �|�}W q�W q0 ty� } zd| jr�| �|�r�|| jk r�|d7 }t| j || j
d�d }| � |� q�t t
d|d�� n� W Y d}~q0d}~0 0 q0|r�|�d�tjkr�|| j|< |S ) z�Get task meta from backend.
if always_retry_backend_operation is activated, in the event of a recoverable exception,
then retry operation with an exponential backoff until a limit has been reached.
r rJ Tr� zfailed to get meta)rg Nr� )r� rV r� �_get_task_meta_forr� r[ r� rK r* r] r\ r� r) r rZ r �SUCCESS)r: rg �cacher� rh r{ r� r5 r5 r6 r� Q s8
��
�
zBackend.get_task_metac C s | j |dd�| j|< dS )z;Reload task result, even if it has been previously fetched.F�r� N)r� rV r� r5 r5 r6 �reload_task_resultx s zBackend.reload_task_resultc C s | j |dd�| j|< dS )z<Reload group result, even if it has been previously fetched.Fr� N)�get_group_metarV �r: rq r5 r5 r6 �reload_group_result| s zBackend.reload_group_resultc C sP | � � |r,z | j| W S ty* Y n0 | �|�}|rL|d urL|| j|< |S r9 )r� rV r� �_restore_group�r: rq r� rh r5 r5 r6 r� � s
zBackend.get_group_metac C s | j ||d�}|r|d S dS )zGet the result for a group.r� rl N)r� r� r5 r5 r6 �
restore_group� s zBackend.restore_groupc C s | � ||�S )z&Store the result of an executed group.)� _save_group�r: rq rl r5 r5 r6 �
save_group� s zBackend.save_groupc C s | j �|d � | �|�S r9 )rV r� �
_delete_groupr� r5 r5 r6 � delete_group� s zBackend.delete_groupc C s dS )zBackend cleanup.Nr5 r� r5 r5 r6 �cleanup� s zBackend.cleanupc C s dS )z:Cleanup actions to do at the end of a task worker process.Nr5 r� r5 r5 r6 �process_cleanup� s zBackend.process_cleanupc C s i S r9 r5 )r: Zproducerrg r5 r5 r6 � on_task_call� s zBackend.on_task_callc C s t d��d S )Nz%Backend does not support add_to_chordr� )r: Zchord_idrl r5 r5 r6 � add_to_chord� s zBackend.add_to_chordc K s d S r9 r5 )r: rF rm rl r4 r5 r5 r6 rk � s z Backend.on_chord_part_returnc C s d S r9 r5 )r: rq �
chord_sizer5 r5 r6 �set_chord_size� s zBackend.set_chord_sizec K s� dd� |D �|d< zt |dd �}W n ty8 d }Y n0 |j�dt |dd ��}|d u rr| jjj�||j�d j}|j�dt |dd��}| jj d j
|j |f||||d � d S )
Nc S s g | ] }|� � �qS r5 �r� ��.0�rr5 r5 r6 �
<listcomp>� � z1Backend.fallback_chord_unlock.<locals>.<listcomp>rl r� r� �priorityr zcelery.chord_unlock)� countdownr� r ) r� r rw rZ r1 ZamqpZrouterZrouter� �tasksr� rx )r: �
header_result�bodyr r4 Z body_typer� r r5 r5 r6 �fallback_chord_unlock� s
�z Backend.fallback_chord_unlockc C s d S r9 r5 r� r5 r5 r6 �ensure_chords_allowed� s z Backend.ensure_chords_allowedc K s, | � � | jj|� }| j||fi |�� d S r9 )r r1 r r �r: Zheader_result_argsr r4 r r5 r5 r6 � apply_chord� s zBackend.apply_chordc C s0 |pt t� dd �}|r,dd� t |dg �D �S d S )NrF c S s g | ] }|� � �qS r5 r r r5 r5 r6 r � r
z1Backend.current_task_children.<locals>.<listcomp>r� )r� r )r: rF r5 r5 r6 r� � s z Backend.current_task_childrenr5 c C s |si n|}t | j||ffS r9 )r7 � __class__�r: r3 r4 r5 r5 r6 �
__reduce__� s zBackend.__reduce__)NNNNNN)F)N)N)N)N)N)TF)NN)T)T)T)rJ )N)r5 N)Er> r? r@ r r� ZUNREADY_STATESr� r Zsubpolling_interval�supports_native_joinZsupports_autoexpirer� Z retry_policyra rd ri r� rn �FAILUREr| rz ZREVOKEDr� �RETRYr� r� r� r� r� r� r� r� r� r� r� rW r� r� r� r� r� re r� r� r� �
get_statusr� r� r� r� r� r� r� r� r� r� r� r r r r r rk r r r r r� r r5 r5 r5 r6 rH Q s� � �
�
�
8.�
�
G
�
3 �
"
'
rH c @ sH e Zd Zddd�Zddd�Zddd �Zdd d �Zd
d� Zedd� �Z dS )�SyncBackendMixinN� �?Tc c sl | � � |j}|sd S t� }|D ]*}t|t�r>|j|jfV q |�|j� q | j||||||d�E d H d S )N)�timeout�interval�no_ack�
on_message� on_interval)r� �results�setr� r rx �add�get_many) r: rl r r! r" r# r$ r% �task_idsr5 r5 r6 � iter_native� s
�z SyncBackendMixin.iter_nativec
C sN | � � |d urtd��| j|j||||d�} | rJ|�| � |j||d�S d S )Nz,Backend does not support on_message callback)r r! r$ r" )� propagater� )r� r �wait_forrx Z_maybe_set_cacheZ maybe_throw)
r: rl r r! r" r# r$ r� r+ rh r5 r5 r6 �wait_for_pending� s ��
z!SyncBackendMixin.wait_for_pendingc C s^ | � � d}| �|�}|d tjv r(|S |r2|� t�|� ||7 }|r ||kr td��q dS )aL Wait for task and return its result.
If the task raises an exception, this exception
will be re-raised by :func:`wait_for`.
Raises:
celery.exceptions.TimeoutError:
If `timeout` is not :const:`None`, and the operation
takes longer than `timeout` seconds.
g r� zThe operation timed out.N)r� r� r r� r� r� r )r: rg r r! r" r$ Z time_elapsedrh r5 r5 r6 r, � s
zSyncBackendMixin.wait_forFc C s |S r9 r5 )r: rl r0 r5 r5 r6 �add_pending_result s z#SyncBackendMixin.add_pending_resultc C s |S r9 r5 r� r5 r5 r6 �remove_pending_result s z&SyncBackendMixin.remove_pending_resultc C s dS rD r5 r� r5 r5 r6 �is_async s zSyncBackendMixin.is_async)Nr TNN)Nr TNNNT)Nr TN)F)
r> r? r@ r* r- r, r. r/ �propertyr0 r5 r5 r5 r6 r � s �
�
�
r c @ s e Zd ZdZdS )r+ z"Base (synchronous) result backend.N�r> r? r@ �__doc__r5 r5 r5 r6 r+ $ s r+ c s e Zd ZeZdZdZdZdZ� fdd�Z dd� Z
d d
� Z d d � Z d
d� Z
dd� Zdd� Zdd� Zdd� Zdd� Zd=dd�Zd>d d �Zd?d d �Zd@d d!�Zd"d#� Zejfd$d%�Zejfd&d'�Zd(d)d*d(d(d(ejfd+d,�Z d-d.� Z dAd/d0�Z d1d2� Z d3d4� Z d5d6� Z!d7d8� Z"d9d:� Z#d;d<� Z$� Z%S )B�BaseKeyValueStoreBackendzcelery-task-meta-zcelery-taskset-meta-z
chord-unlock-Fc sJ t | jd�r| jj| _t� j|i |�� | �� | �� | jrF| j| _ d S )N�__func__)
r� �key_tr5 �superra �_add_global_keyprefix�_encode_prefixes�implements_incr�_apply_chord_incrr r �r r5 r6 ra 2 s
z!BaseKeyValueStoreBackend.__init__c C sd | j j�di ��dd�}|r`|d dvr0|d7 }|� | j� �| _|� | j� �| _|� | j� �| _dS )a/
This method prepends the global keyprefix to the existing keyprefixes.
This method checks if a global keyprefix is configured in `result_backend_transport_options` using the
`global_keyprefix` key. If so, then it is prepended to the task, group and chord key prefixes.
Z result_backend_transport_options�global_keyprefixNrL z:_-.r� )r1 rP rZ �task_keyprefix�group_keyprefix�chord_keyprefix)r: r= r5 r5 r6 r8 ; s z.BaseKeyValueStoreBackend._add_global_keyprefixc C s. | � | j�| _| � | j�| _| � | j�| _d S r9 )r6 r> r? r@ r� r5 r5 r6 r9 J s z)BaseKeyValueStoreBackend._encode_prefixesc C s t d��d S )Nz Must implement the get method.r� �r: �keyr5 r5 r6 rZ O s z BaseKeyValueStoreBackend.getc C s t d��d S )NzDoes not support get_manyr� )r: �keysr5 r5 r6 �mgetR s z BaseKeyValueStoreBackend.mgetc C s | � ||�S r9 )r& )r: rB r� rm r5 r5 r6 �_set_with_stateU s z(BaseKeyValueStoreBackend._set_with_statec C s t d��d S )Nz Must implement the set method.r� �r: rB r� r5 r5 r6 r& X s z BaseKeyValueStoreBackend.setc C s t d��d S )Nz Must implement the delete methodr� rA r5 r5 r6 �delete[ s z BaseKeyValueStoreBackend.deletec C s t d��d S )NzDoes not implement incrr� rA r5 r5 r6 �incr^ s z BaseKeyValueStoreBackend.incrc C s d S r9 r5 rF r5 r5 r6 �expirea s z BaseKeyValueStoreBackend.expirerb c C s$ |st d|� d���| �| j||�S )z#Get the cache key for a task by id.z task_id must not be empty. Got � instead.)r� � _get_key_forr> )r: rg rB r5 r5 r6 �get_key_for_taskd s z)BaseKeyValueStoreBackend.get_key_for_taskc C s$ |st d|� d���| �| j||�S )z$Get the cache key for a group by id.� group_id must not be empty. Got rJ )r� rK r? �r: rq rB r5 r5 r6 �get_key_for_groupj s z*BaseKeyValueStoreBackend.get_key_for_groupc C s$ |st d|� d���| �| j||�S )z?Get the cache key for the chord waiting on group with given id.rM rJ )r� rK r@ rN r5 r5 r6 �get_key_for_chordp s z*BaseKeyValueStoreBackend.get_key_for_chordc C s" | j }|d��|||�||�g�S )Nrb )r6 �join)r: �prefixrx rB r6 r5 r5 r6 rK v s �z%BaseKeyValueStoreBackend._get_key_forc C sF | � |�}| j| jfD ]&}|�|�rt|t|�d� � S qt|�S )zTake bytes: emit string.N)r6 r> r? �
startswithr �len)r: rB rR r5 r5 r6 �
_strip_prefix} s
z&BaseKeyValueStoreBackend._strip_prefixc c s: |D ]0\}}|d ur| � |�}|d |v r||fV qd S )Nr� )r� )r: �valuesr� �kr� r5 r5 r6 �
_filter_ready� s
z&BaseKeyValueStoreBackend._filter_readyc sJ t |d�r(�fdd���|�� |�D �S � fdd���t|�|�D �S d S )N�itemsc s i | ]\}}� � |�|�qS r5 )rU )r
rW �vr� r5 r6 �
<dictcomp>� s �z=BaseKeyValueStoreBackend._mget_to_results.<locals>.<dictcomp>c s i | ]\}}t � | �|�qS r5 �r )r
�irZ )rC r5 r6 r[ � s �)r� rX rY � enumerate)r: rV rC r� r5 )rC r: r6 �_mget_to_results� s
�
�z)BaseKeyValueStoreBackend._mget_to_resultsNr Tc # sd |d u r dn|}t |t�r |nt|�} t� }
� j} | D ]H} z | | }
W n tyX Y q60 |
d |v r6t| �|
fV |
�| � q6| �|
� d}| �r`t| �}� �� � � fdd�|D ��||�}| �
|� | �dd� |D �� |� � D ]&\}}|d ur�||� t|�|fV q�|�r0|| |k�r0t d|� d ���|�r<|� t
�|� |d
7 }|r�||kr��q`q�d S ) Nr r� r c s g | ]}� � |��qS r5 )rL )r
rW r� r5 r6 r � s �z5BaseKeyValueStoreBackend.get_many.<locals>.<listcomp>c S s h | ] }t |��qS r5 r\ )r
rZ r5 r5 r6 � <setcomp>� r
z4BaseKeyValueStoreBackend.get_many.<locals>.<setcomp>zOperation timed out (r� rJ )r� r& rV r� r r' �difference_updater� r_ rD rB rY r r� r� )r: r) r r! r" r# r$ Zmax_iterationsr� �idsZ
cached_idsr� rg �cachedZ
iterationsrC r rB r� r5 r� r6 r( � sF
��
z!BaseKeyValueStoreBackend.get_manyc C s | � | �|�� d S r9 )rG rL r� r5 r5 r6 r� � s z BaseKeyValueStoreBackend._forgetc
K s� | j ||||d�}t|�|d< | �|�}|d tjkr:|S z | �| �|�| �|�|� W n8 ty� } z tt | �||d�| �W Y d } ~ n
d } ~ 0 0 |S )N)rl rm rp rF rg r� )rm rg )
r� r r� r r� rE rL r� r r� )
r: rg rl rm rp rF r4 rh Z current_meta�exr5 r5 r6 r� � s �
*z&BaseKeyValueStoreBackend._store_resultc C s( | � | �|�| �d|�� i�tj� |S )Nrl )rE rO r� r� r r� r� r5 r5 r6 r� � s �z$BaseKeyValueStoreBackend._save_groupc C s | � | �|�� d S r9 )rG rO r� r5 r5 r6 r � s z&BaseKeyValueStoreBackend._delete_groupc C s* | � | �|��}|s tjdd�S | �|�S )�$Get task meta-data for a task by id.N)r� rl )rZ rL r �PENDINGr� rf r5 r5 r6 r� � s z+BaseKeyValueStoreBackend._get_task_meta_forc C s> | � | �|��}|r:| �|�}|d }t|| j�|d< |S dS )re rl N)rZ rO r� r r1 )r: rq rh rl r5 r5 r6 r� � s
z'BaseKeyValueStoreBackend._restore_groupc K s$ | � � | jj|� }|j| d� d S )N�r� )r r1 r �saver r5 r5 r6 r; � s z*BaseKeyValueStoreBackend._apply_chord_incrc K s� | j s
d S | j}|j}|s d S | �|�}ztj|| d�}W nV ty� } z>t|j|d�}
t �
d|| � | � |
t d| ����W Y d } ~ S d } ~ 0 0 |d u �rz t
|��W nZ t
�y } z@t|j|d�}
t �
d|| � | � |
t d|� d���W Y d } ~ S d } ~ 0 0 | �|�} |j�d�} | d u �r,t|�} | | k�rFt �d |� �n�| | k�r�t|j|d�}
|j�rl|jn|j}
�z,z<t� � |
|jjd
d �}W d � n1 �s�0 Y W n~ t�y0 } zdz t|�� �}d �|| �}W n t�y� t | �}Y n0 t �
d||� | � |
t |�� W Y d } ~ ndd } ~ 0 0 z|
� |� W nJ t�y� } z0t �
d|| � | � |
t d
| ���� W Y d } ~ n
d } ~ 0 0 W |� � | � |� n|� � | � |� 0 n| � || j � d S )Nrg r~ zChord %r raised: %rzCannot restore group: z Chord callback %r raised: %rz GroupResult z no longer existsr z/Chord counter incremented too many times for %rT)r r+ z Dependency {0.id} raised {1!r}zCallback error: )!r: r1 r rP r �restorer� r rj �logger� exceptionr� r r� rH rZ rT �warningr Z join_nativerQ r rP Zresult_chord_join_timeout�nextZ_failed_join_report�format�
StopIteration�repr�delayrG rI rX )r: rF rm rl r4 r1 �gidrB �depsr{ r� �val�size�j�retZculpritr� r5 r5 r6 rk � s�
�
�
�
�* �& � �z-BaseKeyValueStoreBackend.on_chord_part_return)rb )rb )rb )rb )NN)&r> r? r@ r r6 r> r? r@ r: ra r8 r9 rZ rD rE r& rG rH rI rL rO rP rK rU r r� rX r_ r( r� r� r� r r� r� r; rk �
__classcell__r5 r5 r< r6 r4 + sF
�
& �
r4 c @ s e Zd ZdZdS )r, z/Result backend base class for key/value stores.Nr2 r5 r5 r5 r6 r, B s r, c @ sP e Zd ZdZi Zdd� Zdd� Zdd� Zdd � Ze Z Z
Z Z e Z
ZZd
S ) r- zDummy result backend.c O s d S r9 r5 r r5 r5 r6 re K s z DisabledBackend.store_resultc C s t t�� ��d S r9 )r� �E_CHORD_NO_BACKEND�stripr� r5 r5 r6 r N s z%DisabledBackend.ensure_chords_allowedc O s t t�� ��d S r9 )r� � E_NO_BACKENDrz r r5 r5 r6 � _is_disabledQ s z DisabledBackend._is_disabledc O s dS )Nz disabled://r5 r r5 r5 r6 rd T s zDisabledBackend.as_uriN)r> r? r@ r3 rV re r r| rd r� r r� r� Zget_task_meta_forr, r( r5 r5 r5 r6 r- F s r- )Tr3 r� r� r� � collectionsr �datetimer � functoolsr �weakrefr Zbilliard.einfor Zkombu.serializationr r r r
rR Zkombu.utils.encodingr r Zkombu.utils.urlr
Zcelery.exceptionsr� r r r r Z
celery._stater Zcelery.app.taskr r r r r r r r r Z
celery.resultr r r r r Zcelery.utils.collectionsr! Zcelery.utils.functionalr" r# Zcelery.utils.logr$ Zcelery.utils.serializationr% r& r' r( r) Zcelery.utils.timer* �__all__� frozensetr� r> rj r_ r/ r{ ry r7 r� r8 rG rH r r+ ZBaseDictBackendr4 r, r- r5 r5 r5 r6 �<module> s^ (
N