History¶
Current version (unreleased)¶
- Add utils.get_repo_state and xarray.document_dataset functions
- Drop explicit testing of dask.gateway rpy2 functionality
- Bugfix in sphinx docs
- Fix to avoid internal calls to GCS API requiring unessesary storage.bucket.get permissions.
v1.2.1¶
Bug fixes:
* raise error on gsutil nonzero status in rhg_compute_tools.gcs.cp
(PR #105
)
v1.2¶
New features: * Adds google storage directory marker utilities and rctools gcs mkdirs command line app
v1.1.4¶
- Add
dask_kwargs
to therhg_compute_tools.xarray
functions
v1.1.3¶
- Add
retry_with_timeout
torhg_compute_tools.utils.py
v1.1.2¶
- Drop
matplotlib.font_manager._rebuild()
call indesign.__init__
- no longer supported (GH #%s96)
v1.1.1¶
- Refactor
datasets_from_delayed
to speed up
v1.1¶
- Add gcs.ls function
v1.0.1¶
- Fix tag kwarg in get_cluster
v1.0.0¶
- Make the gsutil API consistent, so that we have cp, sync and rm, each of which accept the same args and kwargs (GH #%s69)
- Swap
bumpversion
forsetuptools_scm
to handle versioning (GH #%s78) - Cast coordinates to dict before gathering in
rhg_compute_tools.xarray.dataarrays_from_delayed
andrhg_compute_tools.xarray.datasets_from_delayed
. This avoids a mysterious memory explosion on the local machine. Also addname
in the metadata used by those functions so that the name of each dataarray or Variable is preserved. (GH #%s83) - Use
dask-gateway
when available when creating a cluster inrhg_compute_tools.kubernetes
. Add some tests using a local gateway cluster. TODO: More tests. - Add
tag
kwarg torhg_compute_tools.kuberentes.get_cluster
function (PR #87)
v0.2.2¶
- ?
v0.2.1¶
- Add remote scheduler deployment (part of dask_kubernetes 0.10)
- Remove extraneous GCSFUSE_TOKENS env var no longer used in new worker images
- Set library thread limits based on how many cpus are available for a single dask thread
- Change formatting of the extra env_items passed to get_cluster to be a list rather than a list of dict-like name/value pairs
v0.2.0¶
- Add CLI tools (GH #%s37). See
rctools gcs repdirstruc --help
to start - Add new function
rhg_compute_tools.gcs.replicate_directory_structure_on_gcs
to copy directory trees into GCS. Users can authenticate with cred_file or with default google credentials (GH #%s51) - Fixes to docstrings and metadata (GH #%s43) (GH #%s45)
- Add new function
rhg_compute_tools.gcs.rm
to remove files/directories on GCS using thegoogle.cloud.storage
API - Store one additional environment variable when passing
cred_path
torhg_compute_tools.kubernetes.get_cluster
so that thegoogle.cloud.storage
API will be authenticated in addition togsutil
v0.1.8¶
- Deployment fixes
v0.1.7¶
- Design tools: use RHG & CIL colors & styles
- Plotting helpers: generate cmaps with consistent colors & norms, and apply a colorbar to geopandas plots with nonlinear norms
- Autoscaling fix for kubecluster: switch to dask_kubernetes.KubeCluster to allow use of recent bug fixes
v0.1.6¶
- Add
rhg_compute_tools.gcs.cp_gcs
andrhg_compute_tools.gcs.sync_gcs
utilities
v0.1.5¶
- need to figure out how to use this rever thing
v0.1.4¶
- Bug fix again in
rhg_compute_tools.kubernetes.get_worker
v0.1.3¶
- Bug fix in
rhg_compute_tools.kubernetes.get_worker
v0.1.2¶
- Add xarray from delayed methods in
rhg_compute_tools.xarray
(GH #%s12) rhg_compute_tools.gcs.cp_to_gcs
now callsgsutil
in a subprocess instead ofgoogle.storage
operations. This dramatically improves performance when transferring large numbers of small files (GH #%s11)- Additional cluster creation helpers (GH #%s3)
v0.1.1¶
- New google compute helpers (see
rhg_compute_tools.gcs.cp_to_gcs
,rhg_compute_tools.gcs.get_bucket
) - New cluster creation helper (see
rhg_compute_tools.kubernetes.get_worker
) - Dask client.map helpers (see
rhg_compute_tools.utils submodule
)
v0.1.0¶
- First release on PyPI.