vassili/seitime-frappe
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
seitime-frappe/frappe/utils
History
Ankush Menat 73bca16d77 feat: RQ WorkerPool 
RQ now has experimental support for workerpools.

When to use this?

Roughly when you have more than 2 workers a workerpool might make
sense, below 2 it's overhead as master "pool" process will need to run
to manager workerpool itself.

Why is it any better?

Currently we just let supervisor duplicate the worker process N number
of times. This is inefficient from shared memory POV. Forking the
original process to create workers enables sharing of more memory thus
leading upwards of 60-70% reduction in memory usage with pool size of 8
workers.
2023-06-26 18:10:00 +05:30
..
__init__.py perf: reduce memory usage of background processes (#21467) 2023-06-23 12:51:45 +05:30
background_jobs.py feat: RQ WorkerPool 2023-06-26 18:10:00 +05:30
backups.py refactor: Add a maxsplit limit to string splits 2023-01-24 19:22:51 +05:30
bench_helper.py refactor: bench_helper 2022-08-11 23:53:21 +05:30
boilerplate.py chore: use node18 for github workflow 2023-06-26 13:29:18 +05:30
caching.py refactor: frappe.cache() usage to frappe.cache (#21282) 2023-06-08 11:47:17 +05:30
change_log.py perf: reduce memory usage of background processes (#21467) 2023-06-23 12:51:45 +05:30
commands.py fix: correct stacklevel for warnings (#18633) 2022-10-28 12:22:24 +05:30
connections.py refactor!: Merge redis_socketio and redis_queue 2023-06-11 11:40:22 +05:30
csvutils.py Revert "perf: defer many requests imports" 2023-06-24 16:26:22 +05:30
dashboard.py refactor: frappe.cache() usage to frappe.cache (#21282) 2023-06-08 11:47:17 +05:30
data.py perf: Preload and share common python modules 2023-06-24 21:24:02 +05:30
dateutils.py refactor: Add a maxsplit limit to string splits 2023-01-24 19:22:51 +05:30
deprecations.py refactor(db): deprecated unused functions 2022-11-09 16:10:09 +05:30
diff.py refactor: clean up code to py310 supported features (#17367) 2022-07-01 11:51:05 +05:30
doctor.py refactor: clean up code to py310 supported features (#17367) 2022-07-01 11:51:05 +05:30
error.py perf: defer pydoc import 2023-06-24 15:22:01 +05:30
file_lock.py refactor: Move before/after tasks as hooks 2023-02-15 15:30:02 +05:30
file_manager.py fix: support symlinked and /files directory 2022-11-01 13:25:21 +05:30
fixtures.py refactor!: Remove custom script import 2023-06-13 13:13:23 +05:30
formatters.py refactor: clean up code to py310 supported features (#17367) 2022-07-01 11:51:05 +05:30
global_search.py refactor: frappe.cache() usage to frappe.cache (#21282) 2023-06-08 11:47:17 +05:30
goal.py fix!: improved filter validation in Engine.get_query 2023-05-31 14:16:52 +05:30
html_utils.py fix: colwidth should be acceptable 2023-05-15 19:06:11 +05:30
identicon.py refactor: Itenticon 2022-08-11 23:53:21 +05:30
image.py refactor: clean up code to py310 supported features (#17367) 2022-07-01 11:51:05 +05:30
install.py refactor: remove form tour settings 2023-05-25 15:04:38 +05:30
jinja.py refactor: filter out apps not installed on bench 2023-01-16 13:54:40 +05:30
jinja_globals.py refactor: remove txt param from generate_hash use 2022-11-10 11:56:48 +05:30
lazy_loader.py style: format all python files using black (#16453) 2022-04-12 10:59:25 +05:30
logger.py feat: wkhtmltopdf logging (#19935) 2023-05-24 16:00:32 +05:30
make_random.py refactor: make_random 2022-08-11 23:53:21 +05:30
momentjs.py style: format all python files using black (#16453) 2022-04-12 10:59:25 +05:30
nestedset.py refactor: set_value usage 2023-06-13 16:00:43 +05:30
oauth.py perf: defer loading JWT 2023-06-24 19:50:08 +05:30
password.py fix(UX): better error message for Encryption key 2023-06-23 12:40:42 +05:30
password_strength.py refactor: assign instead of update 2023-01-24 13:51:47 +01:00
pdf.py build(deps): PyPDF2 -> pypdf 2023-06-10 20:47:27 +05:30
print_format.py build(deps): PyPDF2 -> pypdf 2023-06-10 20:47:27 +05:30
redis_queue.py refactor: normalize redis invocation and unblock unix domain socket conn (#21309) 2023-06-13 21:06:06 +05:30
redis_wrapper.py refactor: frappe.cache() usage to frappe.cache (#21282) 2023-06-08 11:47:17 +05:30
response.py build(deps): bump many dependencies 2023-06-10 20:47:27 +05:30
safe_exec.py refactor!: Drop previously deprecated code 2023-06-13 16:00:43 +05:30
scheduler.py perf: reduce memory usage of background processes (#21467) 2023-06-23 12:51:45 +05:30
synchronization.py feat: operation level locking for CLI commands (#19162) 2022-12-08 13:24:43 +05:30
telemetry.py chore: Fix linter warning 2023-06-26 09:15:20 +05:30
testutils.py style: format all python files using black (#16453) 2022-04-12 10:59:25 +05:30
typing_validations.py refactor: validate_argument_types 2022-12-19 15:07:03 +05:30
user.py refactor: frappe.cache() usage to frappe.cache (#21282) 2023-06-08 11:47:17 +05:30
verified_command.py refactor: hmac generation 2022-11-12 13:05:57 +05:30
weasyprint.py fix: handle "No Letterhead" in new print format builder (#18990) 2022-11-24 10:54:46 +05:30
xlsxutils.py refactor: use provide_binary_file 2022-11-26 20:08:50 +01:00