Scott Gasch [Mon, 7 Feb 2022 02:34:05 +0000 (18:34 -0800)]
Add a doctest to type_utils.py.
Scott Gasch [Mon, 7 Feb 2022 00:35:16 +0000 (16:35 -0800)]
Get mypy to stop with this fucking "has no attribute" shit when
importing a submodule. I am probably doing something wrong here but I
have no idea what.
Scott Gasch [Sun, 6 Feb 2022 23:14:14 +0000 (15:14 -0800)]
Give deps more time to run.
Scott Gasch [Sun, 6 Feb 2022 23:12:38 +0000 (15:12 -0800)]
Add another profanity.
Scott Gasch [Sun, 6 Feb 2022 21:45:21 +0000 (13:45 -0800)]
Add a simple test for waitable presence.
Scott Gasch [Sat, 5 Feb 2022 22:09:59 +0000 (14:09 -0800)]
Add doctest to misc_utils.
Scott Gasch [Sat, 5 Feb 2022 22:06:25 +0000 (14:06 -0800)]
Add a bunch of __init__.py's; maybe this will fix import
problems with mypy?
Scott Gasch [Sat, 5 Feb 2022 18:04:06 +0000 (10:04 -0800)]
Change threshold.
Scott Gasch [Sat, 5 Feb 2022 17:41:31 +0000 (09:41 -0800)]
Missed one.
Scott Gasch [Sat, 5 Feb 2022 17:38:32 +0000 (09:38 -0800)]
Add coding comments for files with utf8 characters in there.
Scott Gasch [Sat, 5 Feb 2022 17:30:07 +0000 (09:30 -0800)]
Add sparkline helper.
Scott Gasch [Fri, 4 Feb 2022 20:18:03 +0000 (12:18 -0800)]
Adds some doctests to site_config.
Scott Gasch [Fri, 4 Feb 2022 20:13:37 +0000 (12:13 -0800)]
Have bootstrap log the site_config at program initialization.
Scott Gasch [Fri, 4 Feb 2022 17:48:56 +0000 (09:48 -0800)]
Stop trying to cache mac addresses from house and cabin in the same
file.
Scott Gasch [Fri, 4 Feb 2022 16:23:14 +0000 (08:23 -0800)]
Fix a bug in device.py around the type of keywords, add logging and
add manage_switch_off_timers to the deps run at each checkin.
Scott Gasch [Fri, 4 Feb 2022 03:39:40 +0000 (19:39 -0800)]
Make it clear in arg message that this is a library. Dependency
inject the index file name to the c'tor to override the flag.
Scott Gasch [Fri, 4 Feb 2022 03:37:38 +0000 (19:37 -0800)]
Make it possible for users of this library to override argparse's
epilog message.
Scott Gasch [Fri, 4 Feb 2022 03:29:59 +0000 (19:29 -0800)]
Add cron.py, a pretty important (and easy) one.
Scott Gasch [Thu, 3 Feb 2022 23:47:25 +0000 (15:47 -0800)]
Make this thing actually work.
Scott Gasch [Thu, 3 Feb 2022 23:44:32 +0000 (15:44 -0800)]
Add a formatter that handles raw help text, optionally.
Scott Gasch [Thu, 3 Feb 2022 23:42:44 +0000 (15:42 -0800)]
Make the parallelize intergration test short enough to run at
checkin time and enable it.
Scott Gasch [Thu, 3 Feb 2022 22:41:29 +0000 (14:41 -0800)]
Add a "unittest" that runs stuff like reminder and unscramble
etc... to just make sure they don't crash.
Scott Gasch [Thu, 3 Feb 2022 22:18:37 +0000 (14:18 -0800)]
Change settings in flake8 and black.
Scott Gasch [Thu, 3 Feb 2022 22:04:07 +0000 (14:04 -0800)]
Take the lock before unlinking the mmap'ed shared memory to ensure
all writes are finished and visible.
Scott Gasch [Thu, 3 Feb 2022 19:53:51 +0000 (11:53 -0800)]
Disallow where're too.
Scott Gasch [Thu, 3 Feb 2022 19:38:01 +0000 (11:38 -0800)]
Merge branch 'master' of ssh://git.house/usr/local/git/base/python_utils
Scott Gasch [Thu, 3 Feb 2022 19:36:13 +0000 (11:36 -0800)]
Contractions and stuff in string_utils.
Scott [Thu, 3 Feb 2022 19:18:21 +0000 (11:18 -0800)]
Contractions and stuff in string_utils.
Scott [Thu, 3 Feb 2022 07:37:32 +0000 (23:37 -0800)]
Let's call the base class' c'tor first, eh?
Scott [Thu, 3 Feb 2022 07:36:39 +0000 (23:36 -0800)]
Stop spamming the log from bg.
Scott [Thu, 3 Feb 2022 07:35:38 +0000 (23:35 -0800)]
Fix a bug in histogram.
Scott [Wed, 2 Feb 2022 21:47:36 +0000 (13:47 -0800)]
Let's be explicit with asserts; there was a bug in histogram
caused by assert foo when foo was an int with valid valid 0.
Scott [Wed, 2 Feb 2022 21:09:30 +0000 (13:09 -0800)]
Make subdirs type clean too.
Scott [Wed, 2 Feb 2022 20:13:27 +0000 (12:13 -0800)]
Used isort to sort imports. Also added to the git pre-commit hook.
Scott [Wed, 2 Feb 2022 19:09:18 +0000 (11:09 -0800)]
mypy clean!
Scott [Wed, 2 Feb 2022 18:35:08 +0000 (10:35 -0800)]
Fix a problem introduced with previous type cleanup change.
Scott [Wed, 2 Feb 2022 17:14:12 +0000 (09:14 -0800)]
More type annotations.
Scott [Wed, 2 Feb 2022 16:31:42 +0000 (08:31 -0800)]
More mypy cleanup.
Scott [Wed, 2 Feb 2022 04:14:13 +0000 (20:14 -0800)]
More mypy cleanup... ugh.
Scott [Tue, 1 Feb 2022 05:38:46 +0000 (21:38 -0800)]
Myre mypy fixes.
Scott [Tue, 1 Feb 2022 05:03:41 +0000 (21:03 -0800)]
Clean up mypy type checker errors.
Scott [Mon, 31 Jan 2022 20:00:11 +0000 (12:00 -0800)]
Fix a couple of bugs in date parsing.
Scott [Mon, 31 Jan 2022 18:03:43 +0000 (10:03 -0800)]
Adds a quiet option to executor shutdown.
Scott [Mon, 31 Jan 2022 17:58:30 +0000 (09:58 -0800)]
Tweak histograms in executors to include seconds label.
Scott [Mon, 31 Jan 2022 17:55:30 +0000 (09:55 -0800)]
Make histogram auto-format labels.
Scott [Mon, 31 Jan 2022 17:13:00 +0000 (09:13 -0800)]
If percent > 0, even if it's very small, render some little sliver of
a bar.
Scott [Mon, 31 Jan 2022 17:08:57 +0000 (09:08 -0800)]
Use a label formatter for prettier histograms.
Scott [Mon, 31 Jan 2022 17:04:07 +0000 (09:04 -0800)]
Clean up histogram __repr__
Scott [Mon, 31 Jan 2022 17:02:59 +0000 (09:02 -0800)]
Make run_tests.sh re-run a subset of the tests w/o coverage
instrumentation even in --coverage mode.
Scott [Mon, 31 Jan 2022 06:57:29 +0000 (22:57 -0800)]
--unittests_ignore_perf shouldn't mess with the database / file
layer at all. When the db was down some of tests failed even
though they didn't care about perf. Let's not do that.
Scott [Mon, 31 Jan 2022 06:09:43 +0000 (22:09 -0800)]
Fix a recent bug in executors. Thread executor needs to return
its future.
Scott [Mon, 31 Jan 2022 05:29:34 +0000 (21:29 -0800)]
Change locking boundaries for shared dict. Add a unit test.
Make smart_futures re-raise exceptions that happened in futures.
Mess with file_utils.
Scott [Mon, 31 Jan 2022 01:37:58 +0000 (17:37 -0800)]
Improve the locking decorators; @synchronized(lock).
Scott [Mon, 31 Jan 2022 01:36:47 +0000 (17:36 -0800)]
Adds a shutdown_if_idle method to the executors and also eliminates
a multiple-shutdown problem encountered when using them.
Scott [Mon, 31 Jan 2022 01:34:51 +0000 (17:34 -0800)]
Adds MIT license / copyright to string utils from original source
of code.
Scott [Mon, 31 Jan 2022 01:30:11 +0000 (17:30 -0800)]
Add MIT License and copyright from the shared dict implementation
I based this code on.
Scott [Mon, 31 Jan 2022 01:25:59 +0000 (17:25 -0800)]
Add a MP shared dict.
Scott [Sun, 30 Jan 2022 22:53:33 +0000 (14:53 -0800)]
Add some new helper methods to file utils.
Scott [Sun, 30 Jan 2022 22:49:52 +0000 (14:49 -0800)]
Optionally surface exceptions that happen under executors by reading
them off the returned futures.
Scott [Sun, 30 Jan 2022 22:48:32 +0000 (14:48 -0800)]
Do not adjust task count from a child process or thread; always
do it in the launcher thread/process.
Scott [Fri, 28 Jan 2022 19:05:03 +0000 (11:05 -0800)]
Get rid of "fuzzy matches" in favor of a window size param.
Scott [Thu, 27 Jan 2022 21:42:09 +0000 (13:42 -0800)]
Adding test code trying to improve test coverage.
Scott [Thu, 27 Jan 2022 20:09:50 +0000 (12:09 -0800)]
Started using flake8 to lint; removed some of its warnings.
Scott [Thu, 27 Jan 2022 19:03:36 +0000 (11:03 -0800)]
Add --trace_memory to bootstrap.
Scott [Thu, 27 Jan 2022 18:34:30 +0000 (10:34 -0800)]
Add --run_profiler option.
Scott [Thu, 27 Jan 2022 17:29:07 +0000 (09:29 -0800)]
Make the worker selection heuristics work harder to avoid backup
bundles scheduled on the same machine as their primary.
Scott [Thu, 27 Jan 2022 16:45:48 +0000 (08:45 -0800)]
Testing auto formatting
Scott [Thu, 27 Jan 2022 05:50:11 +0000 (21:50 -0800)]
Another formatter test, whee...
Scott [Thu, 27 Jan 2022 05:46:30 +0000 (21:46 -0800)]
Trying to get black to run in git's pre-commit hook and actually
modify the files...
Scott [Thu, 27 Jan 2022 05:35:20 +0000 (21:35 -0800)]
Ahem. Still running black?
Scott [Thu, 27 Jan 2022 05:34:26 +0000 (21:34 -0800)]
Ran black code formatter on everything.
Scott [Thu, 27 Jan 2022 05:24:56 +0000 (21:24 -0800)]
Remove missing import.
Scott [Thu, 27 Jan 2022 05:19:41 +0000 (21:19 -0800)]
Reformatting.
Scott [Thu, 27 Jan 2022 05:18:33 +0000 (21:18 -0800)]
Fix missing f's.
Scott [Wed, 26 Jan 2022 23:36:05 +0000 (15:36 -0800)]
Reformatting.
Scott [Wed, 26 Jan 2022 19:26:55 +0000 (11:26 -0800)]
Make sanity check optional.
Scott [Wed, 26 Jan 2022 19:24:46 +0000 (11:24 -0800)]
Sanity check list is sorted before binary search.
Scott [Wed, 26 Jan 2022 19:15:14 +0000 (11:15 -0800)]
Minor tweaks.
Scott [Wed, 26 Jan 2022 18:31:53 +0000 (10:31 -0800)]
Add type hints and cleanup.
Scott [Wed, 26 Jan 2022 17:28:53 +0000 (09:28 -0800)]
Make unscrambler use a cache per instance instead of module and
make it have non-static methods.
Scott [Wed, 26 Jan 2022 06:16:24 +0000 (22:16 -0800)]
Unscrambler.py is no longer a utility; see ~bin/unscramble.py.
Scott [Wed, 26 Jan 2022 06:15:08 +0000 (22:15 -0800)]
Clarify instructions for repopulation.
Scott [Wed, 26 Jan 2022 06:05:25 +0000 (22:05 -0800)]
Adds unscrambler which contains the guts of a jumble/scrabble player
I wrote outside of here.
Scott [Tue, 25 Jan 2022 04:20:16 +0000 (20:20 -0800)]
Enable scp compression on remote executor to try to improve data
xfer times.
Scott [Tue, 25 Jan 2022 04:19:26 +0000 (20:19 -0800)]
Fix a newly introduced bug in run_tests.sh.
Scott [Mon, 24 Jan 2022 23:55:24 +0000 (15:55 -0800)]
Improve run_tests.sh
Scott [Mon, 24 Jan 2022 23:42:09 +0000 (15:42 -0800)]
Report overall runtime in periodic status dumps.
Scott [Mon, 24 Jan 2022 22:55:09 +0000 (14:55 -0800)]
Improve run_tests.sh
Scott [Mon, 24 Jan 2022 22:51:17 +0000 (14:51 -0800)]
Make parallelize remember to shutdown the default executors atexit.
Scott [Mon, 24 Jan 2022 22:48:49 +0000 (14:48 -0800)]
Add repro instructions for coverage in run_tests.sh.
Scott [Mon, 24 Jan 2022 21:57:51 +0000 (13:57 -0800)]
Finish up this coverage stuff.
Scott [Mon, 24 Jan 2022 21:47:27 +0000 (13:47 -0800)]
Adds optional code coverage reporting to run_tests.sh.
Scott [Mon, 24 Jan 2022 16:47:00 +0000 (08:47 -0800)]
This stuff all still sucks but this is slightly better.
Scott [Mon, 24 Jan 2022 16:25:33 +0000 (08:25 -0800)]
Add my own splitter.
Scott [Mon, 24 Jan 2022 00:13:44 +0000 (16:13 -0800)]
Make profanity filter catch foo/bar where foo and/or bar are bad
words.
Scott [Sun, 23 Jan 2022 20:58:13 +0000 (12:58 -0800)]
Minor cleanup.
Scott [Sun, 23 Jan 2022 20:43:46 +0000 (12:43 -0800)]
Clean up the remote executor stuff and create a dedicated heartbeat
thread. Fix the parallelize integration test. Other changes that
depended on these fixes.
Scott [Sun, 23 Jan 2022 18:08:17 +0000 (10:08 -0800)]
Added some helpers to file_utils and improved the docs/doctests.
Scott [Sun, 23 Jan 2022 01:30:42 +0000 (17:30 -0800)]
Reformatting.
Scott [Sun, 23 Jan 2022 01:29:09 +0000 (17:29 -0800)]
Reformatting.