Draft
Conversation
…-streaming#294) * re-import orjson module for json serialization/deserialization * fix test Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com>
* fix typos in README.md * fix other typos in README.md
…ng#312 (faust-streaming#313) * Faust commits the wrong offset in case of a gap in acks faust-streaming#312 Faust commits the wrong offset in case of a gap in acks faust-streaming#312 Co-Authored-By: ekerstens <49325583+ekerstens@users.noreply.github.com> * kljlk jhkjhj * Revert "kljlk" This reverts commit 8b487fc. * update fix faust-streaming#313 Co-Authored-By: ekerstens <49325583+ekerstens@users.noreply.github.com> * update test case Co-Authored-By: ekerstens <49325583+ekerstens@users.noreply.github.com> Co-Authored-By: Leo <47164895+LeohuangLeo@users.noreply.github.com> Co-authored-by: Leo Huang <s3563602123@gmail.com> Co-authored-by: ekerstens <49325583+ekerstens@users.noreply.github.com> Co-authored-by: Leo <47164895+LeohuangLeo@users.noreply.github.com>
faust-streaming#289) * fix: pessimistically lookup the earliest key The earliest_offset function in the consumer seems to not always return all tps which have been passed in but presumabely only the ones it has data for. After longer runtime it seems that the response MAY return a dict not filled with all topic partitions which have been added. To bypass this and not lead faust to crash, use the .get function on the returned mapping and default to None on return. * chore: flake8 fixes Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com>
* Fix flake warning with bound loop var * fix variable names
faust-streaming#325) * If changelog topic partitions are only listed in the actives_tps set and not in standbys, then those partitions need to be resumed to ensure GlobalTable stays in sync for all workers * fix recovery linting * pass flake8 test Co-authored-by: lmetzger <lorinmetzger@gmail.com> Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com>
Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com>
* Fixed filter not acking filtered out messages. * Removed debug print from test. * Added Cython implementation for the filter fix. Co-authored-by: Matthew Drago <matthew.drago@gig.com> Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com> Co-authored-by: Taybin Rutkin <taybin@users.noreply.github.com>
* create method for backing up partition * if we're not flushing, just directly read the db * annotate backup method * Define backup_partition in StoreT baseclass and derivatives * change partition to tp * change partition to union tp or int since all we care about is partition index * fix error log * add method to restore backups * add forgotten ellipses * remove misleading docstring * Check if backup path is directory and make paths * Convert partition paths used in restoration to str * dedicate backup path by tablename * update backup docstring * dont import BackupEngine to fix linting * commit lint changes * reformat docstrings * add general Exception * add backup_partition and restore_backup to MyStore test class * add backup_partition and restore_backup to MySerializedStore test class * check permissions to create dirs and write to backup dir before spawning backupengine * remove redundant exception handle * add backup methods to ChangeloggedObjectManager Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com>
* Remove a broken link in Readme.md The link for open file limit was dead. The solution is elaborated in a short, compact way. * Reformat code * Fix formatting * Move noqa note to propagate * Fix formatting in streams.py Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
Correct pypi link, tar filename and path
* commit inital fix for faust-streaming#333 * manually lint comment * allow multiple partitions to resume * minor cleanup
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
…ng workers (faust-streaming#331) * allow 'read_only' to be passed through options * only apply read_only if the file doesn't already exist * pass read_only kwarg to test to fix test bug * call options.pop for brevity * add note to docs for read_only option
* add dist.yml for uploading sdists to pypi * update dist workflow for macos
…reaming#282) * adding intervaltree to manage gaps in topics to prevent OOM * adding intervaltree to manage gaps in topics to prevent OOM * remove old consumer test TPs Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* build wheels for more platforms * enforce 64-bit only builds
Co-authored-by: Vikram Patki <54442035+patkivikram@users.noreply.github.com> Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* point mode to faust screaming fork * update other links
…ssage (faust-streaming#342) * Address topics.py error in faust-streaming#175 * manually fix linting
* add noqa: B024 to base classes to pass lint check * append noqa to type ignore
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
…ming#145) * rename default.txt requirements to requirements.txt in Makefile * fix docs.txt and dist.txt requirements files * add pre-commit support with flake8 back Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* cleanup requirements and references to authors and changelog * update sphinx requirements * disable flake8 to minimize inconvenience for devleopers for now * change Signature import * update AUTHORS.md * use m2r2 and mdinclude * upgrade docs for new version of sphinx * create test branch for gh-pages * disable make build call * fix pages branch * disable building * correct inputs * specify inputs properly * add six to dependencies * change branch * add requirements.txt to docs.txt * try another approach * add test branch * update token permissions * add persist-credentials * update action versions * never mind * enable GITHUB TOKEN * enable contents:write * force for now * force for now * try deploy-pages * reorganize * remove sphinx-notes * fix path to Documentation * cleanup * revert title reformat * update all references from fauststreaming/latest to faust-stream.github.io * fix typos to faust-streaming * fix travis links * update release procedure on contributing.rst
…eaming#522) Co-authored-by: Richard Hundt <richard@silicon.ai> Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
…on >= 3.8 (faust-streaming#524) * Update CI/CD workflows * disable cython for 3.12 and pypy3.9 * forgot to disable tests for 3.7 * properly disable cython * syntax is annoying * we should only test with orjson if we have cython installed * allow experimentals to fail * a test should take no longer than ten minutes * i guess we can't use continue-on-error that way then * test cibuildwheel * revert dist.yml changes * disable testing for 3.12 until properly supported in August or so * disable scripts/coverage call in scripts/tests because we already do it in a separate job * remove old tests and disable timeout * dsiable integ * try skipping meticulous tests * disable pypy tests for now * fix typo * extend timeout * switch over setup.cfg to pyproject.toml * fix linting * flake8 is impossible to please apparently * update gh-pages.yml * fix all yamls * fix requirements seutp * cleanup * should continue on false * fix continue on error placement * check linting only * Update python-package.yml to use experimental * Update python-package.yml * Update tests to run meticulous again * Update python-package.yml to allow 3.12 to fail * just disable 3.12 for now * Update python-package.yml to not test pypy until we figure this out * Update python-package.yml to extend job timeout to 10m * consolidate dist.yml into python-package.yml * update pyproject.toml with proper cibuildwheel config * forgot fetch-depth for wheel builds * reformat * skip builds for musllinux_x86_64 * enable check requirement * revert drastic changes for linting * pull in new changes from master
* Skip failing tests on PyPy for now * use move pypy3.9 into main tests * never mind pypy is experimental then * skip meticulous tests on pypy * no cython w/pypy for now * skip janky tests on pypy * lint * rename workflow * add asyncio_mode = "auto" to pyproject.toml * undo disabled tests in functional test_streams.py * enable regular stream testing for unit tests
…t-streaming#531) Co-authored-by: o.stetsenko <oleksandr.stetsenko@playtech.com>
Bumps [actions/upload-pages-artifact](https://github.com/actions/upload-pages-artifact) from 1 to 2. - [Release notes](https://github.com/actions/upload-pages-artifact/releases) - [Commits](actions/upload-pages-artifact@v1...v2) --- updated-dependencies: - dependency-name: actions/upload-pages-artifact dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump rocksdict to v0.3.13 * Use rocksdict>=0.3.11,<4.0
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v3...v4) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 3 to 4. - [Release notes](https://github.com/codecov/codecov-action/releases) - [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md) - [Commits](codecov/codecov-action@v3...v4) --- updated-dependencies: - dependency-name: codecov/codecov-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [venusian](https://github.com/Pylons/venusian) from 3.0.0 to 3.1.0. - [Changelog](https://github.com/Pylons/venusian/blob/main/CHANGES.rst) - [Commits](Pylons/venusian@3.0.0...3.1.0) --- updated-dependencies: - dependency-name: venusian dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* Fix races in conductor with dynamic agents * Add documentation for `_resubscribe_sleep_lock_seconds` --------- Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
…etadata definitions into pyproject.toml (faust-streaming#574) * Consolidate dynamic attributes for setuptools v69.0.0 * commit functioning build * forgot to lint setup.py lol * Update authors and maintainers metadata * remove redundant name metadata definition * Revert "remove redundant name metadata definition" This reverts commit 0263fa6. * bring back long_description in setup.py
* Update setup.py to use setuptools_scm * Update setup.py
* add fastapi dir and change dep to rocksdict * commit inital example * update example * use lifespan * reorganize to have an endpoint trigger a producer * reorganize timer to be above fast api decorator
Mopsgeschwindigkeit
changed the title
Sxbigtable
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
merged newest upstream master (v0.10.21~7)