feat(taskworker): Add Push Mode to Taskworker

[james-mcnulty]

Linear

Completes STREAM-822

Description

Currently, taskworkers pull tasks from taskbrokers via RPC. This approach works, but has some drawbacks. Therefore, we want taskbrokers to push tasks to taskworkers instead. Read this page on Notion for more information.

This PR allows users to run the taskworker in push mode via the --push-mode and --grpc-port CLI options.

Option	Type	Default	Description
--push-mode	bool	False	Whether to run in push or pull mode.
--grpc-port	int	50052	The port to use for the taskworker gRPC server.

Details

Dependencies

• Upgrade sentry-protos from 0.4.11 to 0.8.5 (to use the new worker service schema)

Additions

• Define WorkerServicer class in worker.py
• Add push_mode and grpc_port fields to TaskWorker and TaskbrokerClient classes
• Add push_task method to TaskWorker class
• Add gauge method to metrics backend abstract class
• Add unit tests for push mode

Modifications

• Start gRPC server if push mode, enter pull loop if pull mode
• Add _get_stub method to TaskbrokerClient to connect to brokers on the fly by using the activation callback URL

[linear-code]

STREAM-822 Add Push Mode to Taskworker

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

^{Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}