reactor.extra.processor

Class WorkQueueProcessor<E>

java.lang.Object

reactor.core.publisher.Flux<OUT>

reactor.core.publisher.FluxProcessor<IN,IN>

reactor.extra.processor.WorkQueueProcessor<E>

Type Parameters:

E - Type of dispatched signal

All Implemented Interfaces:

Runnable, Processor<E,E>, Publisher<E>, Subscriber<E>, CorePublisher<E>, CoreSubscriber<E>, Disposable, Scannable

Deprecated.

Processors are being phased out entirely. To be removed in 3.5, see https://github.com/reactor/reactor-core/issues/2431

@Deprecated
public final class WorkQueueProcessor<E>
extends FluxProcessor<IN,IN>

An implementation of a RingBuffer backed message-passing Processor implementing work-queue distribution with async event loops.

Created from Flux.share(), the WorkQueueProcessor will authorize concurrent publishing (multi-producer) from its receiving side Subscriber.onNext(Object). WorkQueueProcessor is able to replay up to its buffer size number of failed signals (either dropped or fatally throwing on child Subscriber.onNext(T)).

The processor is very similar to TopicProcessor but only partially respects the Reactive Streams contract.

The purpose of this processor is to distribute the signals to only one of the subscribed subscribers and to share the demand amongst all subscribers. The scenario is akin to Executor or Round-Robin distribution. However there is no guarantee the distribution will be respecting a round-robin distribution all the time.

The core use for this component is to scale up easily without suffering the overhead of an Executor and without using dedicated queues by subscriber, which is less used memory, less GC, more win.

Author:

Stephane Maldini

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	reactor.extra.processor.EventLoopProcessor.Slot<T> Deprecated. A simple reusable data container.
static class	WorkQueueProcessor.Builder<T> Deprecated. WorkQueueProcessor builder that can be used to create new processors.

Nested classes/interfaces inherited from interface reactor.core.Scannable

Scannable.Attr<T>

Nested classes/interfaces inherited from interface reactor.core.Disposable

Disposable.Composite, Disposable.Swap

Field Summary

Fields inherited from interface reactor.core.Scannable

OPERATOR_NAME_UNRELATED_WORDS_PATTERN

Method Summary

Modifier and Type	Method and Description
boolean	alive() Deprecated. Determine whether this Processor can be used.
boolean	awaitAndShutdown() Deprecated. Block until all submitted tasks have completed, then do a normal EventLoopProcessor.dispose().
boolean	awaitAndShutdown(java.time.Duration timeout) Deprecated. Block until all submitted tasks have completed, then do a normal EventLoopProcessor#dispose().
boolean	awaitAndShutdown(long timeout, TimeUnit timeUnit) Deprecated. use awaitAndShutdown(Duration) instead
static <T> WorkQueueProcessor.Builder<T>	builder() Deprecated. Create a new WorkQueueProcessor WorkQueueProcessor.Builder with default properties.
static <E> WorkQueueProcessor<E>	create() Deprecated. Create a new WorkQueueProcessor using Queues.SMALL_BUFFER_SIZE backlog size, blockingWait Strategy and auto-cancel.
static <E> WorkQueueProcessor<E>	create(String name, int bufferSize) Deprecated. Create a new WorkQueueProcessor using the passed buffer size, blockingWait Strategy and auto-cancel.
protected static String	defaultName(ThreadFactory threadFactory, Class<? extends reactor.extra.processor.EventLoopProcessor> clazz) Deprecated. A method to extract a name from the ThreadFactory if it turns out to be a Supplier (in which case the supplied value string representation is used).
protected static ExecutorService	defaultRequestTaskExecutor(String name) Deprecated. A method to create a suitable default ExecutorService for use in implementors requestTask(Subscription) (a cached thread pool), reusing a main name and appending [request-task] suffix.
protected void	doComplete() Deprecated.
protected void	doError(Throwable t) Deprecated.
long	downstreamCount() Deprecated.
Flux<E>	drain() Deprecated. Drain is a hot replication of the current buffer delivered if supported.
Flux<IN>	forceShutdown() Deprecated. Shutdown this Processor, forcibly halting any work currently executing and discarding any tasks that have not yet been executed.
long	getAvailableCapacity() Deprecated.
int	getBufferSize() Deprecated.
Throwable	getError() Deprecated.
long	getPending() Deprecated. Return the number of parked elements in the emitter backlog.
int	hashCode() Deprecated.
java.util.stream.Stream<? extends Scannable>	inners() Deprecated.
boolean	isSerialized() Deprecated.
boolean	isTerminated() Deprecated.
void	onComplete() Deprecated.
void	onError(Throwable t) Deprecated.
void	onNext(IN o) Deprecated.
void	onSubscribe(Subscription s) Deprecated.
protected void	requestTask(Subscription s) Deprecated.
void	run() Deprecated.
Object	scanUnsafe(Scannable.Attr key) Deprecated.
protected boolean	serializeAlways() Deprecated.
static <E> WorkQueueProcessor<E>	share(String name, int bufferSize) Deprecated. Create a new shared WorkQueueProcessor using the passed buffer size, blockingWait Strategy and auto-cancel.
void	shutdown() Deprecated. Shutdown this active Processor such that it can no longer be used.
void	subscribe(CoreSubscriber<? super E> actual) Deprecated.
String	toString() Deprecated.

Methods inherited from class reactor.core.publisher.FluxProcessor

currentContext, dispose, hasCompleted, hasDownstreams, hasError, isIdentityProcessor, serialize, sink, sink, switchOnNext, wrap

Methods inherited from class reactor.core.publisher.Flux

all, any, as, blockFirst, blockFirst, blockLast, blockLast, buffer, buffer, buffer, buffer, buffer, buffer, buffer, buffer, buffer, buffer, buffer, bufferTimeout, bufferTimeout, bufferTimeout, bufferTimeout, bufferUntil, bufferUntil, bufferUntilChanged, bufferUntilChanged, bufferUntilChanged, bufferWhen, bufferWhen, bufferWhile, cache, cache, cache, cache, cache, cache, cancelOn, cast, checkpoint, checkpoint, checkpoint, collect, collect, collectList, collectMap, collectMap, collectMap, collectMultimap, collectMultimap, collectMultimap, collectSortedList, collectSortedList, combineLatest, combineLatest, combineLatest, combineLatest, combineLatest, combineLatest, combineLatest, combineLatest, combineLatest, concat, concat, concat, concat, concatDelayError, concatDelayError, concatDelayError, concatDelayError, concatMap, concatMap, concatMapDelayError, concatMapDelayError, concatMapDelayError, concatMapIterable, concatMapIterable, concatWith, concatWithValues, contextWrite, contextWrite, count, create, create, defaultIfEmpty, defer, deferContextual, deferWithContext, delayElements, delayElements, delaySequence, delaySequence, delaySubscription, delaySubscription, delaySubscription, delayUntil, dematerialize, distinct, distinct, distinct, distinct, distinctUntilChanged, distinctUntilChanged, distinctUntilChanged, doAfterTerminate, doFinally, doFirst, doOnCancel, doOnComplete, doOnDiscard, doOnEach, doOnError, doOnError, doOnError, doOnNext, doOnRequest, doOnSubscribe, doOnTerminate, elapsed, elapsed, elementAt, elementAt, empty, error, error, error, expand, expand, expandDeep, expandDeep, filter, filterWhen, filterWhen, first, first, firstWithSignal, firstWithSignal, firstWithValue, firstWithValue, flatMap, flatMap, flatMap, flatMap, flatMapDelayError, flatMapIterable, flatMapIterable, flatMapSequential, flatMapSequential, flatMapSequential, flatMapSequentialDelayError, from, fromArray, fromIterable, fromStream, fromStream, generate, generate, generate, getPrefetch, groupBy, groupBy, groupBy, groupBy, groupJoin, handle, hasElement, hasElements, hide, ignoreElements, index, index, interval, interval, interval, interval, join, just, just, last, last, limitRate, limitRate, limitRequest, log, log, log, log, log, log, map, materialize, merge, merge, merge, merge, merge, merge, mergeDelayError, mergeOrdered, mergeOrdered, mergeOrdered, mergeOrderedWith, mergeSequential, mergeSequential, mergeSequential, mergeSequential, mergeSequential, mergeSequential, mergeSequentialDelayError, mergeSequentialDelayError, mergeSequentialDelayError, mergeWith, metrics, name, never, next, ofType, onAssembly, onAssembly, onBackpressureBuffer, onBackpressureBuffer, onBackpressureBuffer, onBackpressureBuffer, onBackpressureBuffer, onBackpressureBuffer, onBackpressureBuffer, onBackpressureDrop, onBackpressureDrop, onBackpressureError, onBackpressureLatest, onErrorContinue, onErrorContinue, onErrorContinue, onErrorMap, onErrorMap, onErrorMap, onErrorResume, onErrorResume, onErrorResume, onErrorReturn, onErrorReturn, onErrorReturn, onErrorStop, onTerminateDetach, or, parallel, parallel, parallel, publish, publish, publish, publish, publishNext, publishOn, publishOn, publishOn, push, push, range, reduce, reduce, reduceWith, repeat, repeat, repeat, repeat, repeatWhen, replay, replay, replay, replay, replay, replay, retry, retry, retryWhen, sample, sample, sampleFirst, sampleFirst, sampleTimeout, sampleTimeout, scan, scan, scanWith, share, shareNext, single, single, singleOrEmpty, skip, skip, skip, skipLast, skipUntil, skipUntilOther, skipWhile, sort, sort, startWith, startWith, startWith, subscribe, subscribe, subscribe, subscribe, subscribe, subscribe, subscribe, subscribeOn, subscribeOn, subscriberContext, subscriberContext, subscribeWith, switchIfEmpty, switchMap, switchMap, switchOnFirst, switchOnFirst, switchOnNext, switchOnNext, tag, take, take, take, takeLast, takeUntil, takeUntilOther, takeWhile, then, then, thenEmpty, thenMany, timed, timed, timeout, timeout, timeout, timeout, timeout, timeout, timeout, timestamp, timestamp, toIterable, toIterable, toIterable, toStream, toStream, transform, transformDeferred, transformDeferredContextual, using, using, usingWhen, usingWhen, window, window, window, window, window, window, window, windowTimeout, windowTimeout, windowUntil, windowUntil, windowUntil, windowUntilChanged, windowUntilChanged, windowUntilChanged, windowWhen, windowWhile, windowWhile, withLatestFrom, zip, zip, zip, zip, zip, zip, zip, zip, zip, zip, zip, zip, zip, zipWith, zipWith, zipWith, zipWith, zipWithIterable, zipWithIterable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.reactivestreams.Publisher

subscribe

Methods inherited from interface reactor.core.Scannable

actuals, from, isScanAvailable, name, parents, scan, scanOrDefault, stepName, steps, tags

Methods inherited from interface reactor.core.Disposable

isDisposed

Method Detail

builder

public static final <T> WorkQueueProcessor.Builder<T> builder()

Deprecated.

Create a new WorkQueueProcessor WorkQueueProcessor.Builder with default properties.

Returns:

new WorkQueueProcessor builder

create

public static <E> WorkQueueProcessor<E> create()

Deprecated.

Create a new WorkQueueProcessor using Queues.SMALL_BUFFER_SIZE backlog size, blockingWait Strategy and auto-cancel.

A new Cached ThreadExecutorPool will be implicitly created.

Type Parameters:

E - Type of processed signals

Returns:

a fresh processor

create

public static <E> WorkQueueProcessor<E> create(String name,
                                               int bufferSize)

Deprecated.

Create a new WorkQueueProcessor using the passed buffer size, blockingWait Strategy and auto-cancel.

A new Cached ThreadExecutorPool will be implicitly created and will use the passed name to qualify the created threads.

Type Parameters:

E - Type of processed signals

Parameters:

name - Use a new Cached ExecutorService and assign this name to the created threads

bufferSize - A Backlog Size to mitigate slow subscribers

Returns:

a fresh processor

share

public static <E> WorkQueueProcessor<E> share(String name,
                                              int bufferSize)

Deprecated.

Create a new shared WorkQueueProcessor using the passed buffer size, blockingWait Strategy and auto-cancel.

A Shared Processor authorizes concurrent onNext calls and is suited for multi-threaded publisher that will fan-in data.

A new Cached ThreadExecutorPool will be implicitly created and will use the passed name to qualify the created threads.

Type Parameters:

E - Type of processed signals

Parameters:

name - Use a new Cached ExecutorService and assign this name to the created threads

bufferSize - A Backlog Size to mitigate slow subscribers

Returns:

a fresh processor

subscribe

public void subscribe(CoreSubscriber<? super E> actual)

Deprecated.

Specified by:

subscribe in interface CorePublisher<E>

Specified by:

subscribe in class Flux<E>

drain

public Flux<E> drain()

Deprecated.

Drain is a hot replication of the current buffer delivered if supported. Since it is hot there might be no guarantee to see a end if the buffer keeps replenishing due to concurrent producing.

Returns:

a Flux sequence possibly unbounded of incoming buffered values or empty if not supported.

doError

protected void doError(Throwable t)

Deprecated.

doComplete

protected void doComplete()

Deprecated.

requestTask

protected void requestTask(Subscription s)

Deprecated.

getPending

public long getPending()

Deprecated.

Return the number of parked elements in the emitter backlog.

Returns:

the number of parked elements in the emitter backlog.

run

public void run()

Deprecated.

scanUnsafe

@Nullable
public Object scanUnsafe(Scannable.Attr key)

Deprecated.

Specified by:

scanUnsafe in interface Scannable

Overrides:

scanUnsafe in class FluxProcessor<IN,IN>

defaultName

protected static String defaultName(@Nullable
                                    ThreadFactory threadFactory,
                                    Class<? extends reactor.extra.processor.EventLoopProcessor> clazz)

Deprecated.

A method to extract a name from the ThreadFactory if it turns out to be a Supplier (in which case the supplied value string representation is used). Otherwise return the current class's simpleName.

Parameters:

threadFactory - the factory to test for a supplied name

clazz -

Returns:

the name to use in thread pools

defaultRequestTaskExecutor

protected static ExecutorService defaultRequestTaskExecutor(String name)

Deprecated.

A method to create a suitable default ExecutorService for use in implementors requestTask(Subscription) (a cached thread pool), reusing a main name and appending [request-task] suffix.

Parameters:

name - the main thread name used by the processor.

Returns:

a default ExecutorService for requestTask.

alive

public final boolean alive()

Deprecated.

Determine whether this Processor can be used.

Returns:

true if this Resource is alive and can be used, false otherwise.

awaitAndShutdown

public final boolean awaitAndShutdown()

Deprecated.

Block until all submitted tasks have completed, then do a normal EventLoopProcessor.dispose().

Returns:

if the underlying executor terminated and false if the timeout elapsed before termination

awaitAndShutdown

@Deprecated
public final boolean awaitAndShutdown(long timeout,
                                                  TimeUnit timeUnit)

Deprecated. use awaitAndShutdown(Duration) instead

Block until all submitted tasks have completed, then do a normal EventLoopProcessor#dispose().

Parameters:

timeout - the timeout value

timeUnit - the unit for timeout

Returns:

if the underlying executor terminated and false if the timeout elapsed before termination

awaitAndShutdown

public final boolean awaitAndShutdown(java.time.Duration timeout)

Deprecated.

Block until all submitted tasks have completed, then do a normal EventLoopProcessor#dispose().

Parameters:

timeout - the timeout value as a Duration. Note this is converted to a Long of nanoseconds (which amounts to roughly 292 years maximum timeout).

Returns:

if the underlying executor terminated and false if the timeout elapsed before termination

inners

public java.util.stream.Stream<? extends Scannable> inners()

Deprecated.

Specified by:

inners in interface Scannable

Overrides:

inners in class FluxProcessor<IN,IN>

forceShutdown

public final Flux<IN> forceShutdown()

Deprecated.

Shutdown this Processor, forcibly halting any work currently executing and discarding any tasks that have not yet been executed.

Returns:

a Flux instance with the remaining undelivered values

getAvailableCapacity

public final long getAvailableCapacity()

Deprecated.

Returns:

a snapshot number of available onNext before starving the resource

getError

@Nullable
public final Throwable getError()

Deprecated.

Overrides:

getError in class FluxProcessor<IN,IN>

toString

public final String toString()

Deprecated.

Overrides:

toString in class Flux<IN>

hashCode

public final int hashCode()

Deprecated.

Overrides:

hashCode in class Object

isSerialized

public boolean isSerialized()

Deprecated.

Overrides:

isSerialized in class FluxProcessor<IN,IN>

isTerminated

public final boolean isTerminated()

Deprecated.

Overrides:

isTerminated in class FluxProcessor<IN,IN>

onComplete

public final void onComplete()

Deprecated.

Specified by:

onComplete in interface Subscriber<IN>

onError

public final void onError(Throwable t)

Deprecated.

Specified by:

onError in interface Subscriber<IN>

onNext

public final void onNext(IN o)

Deprecated.

Specified by:

onNext in interface Subscriber<IN>

onSubscribe

public final void onSubscribe(Subscription s)

Deprecated.

Specified by:

onSubscribe in interface Subscriber<IN>

Specified by:

onSubscribe in interface CoreSubscriber<IN>

serializeAlways

protected boolean serializeAlways()

Deprecated.

Overrides:

serializeAlways in class FluxProcessor<IN,IN>

shutdown

public final void shutdown()

Deprecated.

Shutdown this active Processor such that it can no longer be used. If the resource carries any work, it will wait (but NOT blocking the caller) for all the remaining tasks to perform before closing the resource.

getBufferSize

public final int getBufferSize()

Deprecated.

Overrides:

getBufferSize in class FluxProcessor<IN,IN>

downstreamCount

public long downstreamCount()

Deprecated.

Overrides:

downstreamCount in class FluxProcessor<IN,IN>