Zaida Zhou
|
32e09f4933
|
[Feature] Upload checkpoints and logs to ceph (#1375)
* [Feature] Choose storage backend by the prefix of filepath
* refactor FileClient and add unittest
* support loading from different backends
* polish docstring
* fix unittet
* rename attribute str_like_obj to is_str_like_obj
* [Docs] Upload checkpoint to petrel oss
* add infer_client method
* Support uploading checkpoint to petrel oss
* add check_exist method
* refactor CheckpointHook
* support uploading logs to ceph
* rename var client to file_client
* polish docstring
* enhance load_from_ceph
* refactor load_from_ceph
* refactor TextLoggerHook
* change the meaning of out_dir argument
* fix test_checkpoint_hook.py
* add join_paths method
* remove join_paths and add _format_path
* enhance unittest
* refactor unittest
* add a unittest for EvalHook when file backend is petrel
* singleton pattern
* fix test_clientio.py
* deprecate CephBackend
* add warning in load_from_ceph
* fix type of out_suffix
* enhance docstring
* refactor unittest for petrel
* refactor unittest for disk backend
* update io.md
* add concat_paths method
* fix CI
* mock check_exist
* improve docstring
* improve docstring
* improve docstring
* improve docstring
* add isdir and copyfile for file backend
* delete copyfile and add get_local_path
* remove isdir method of petrel
* fix typo
* rename check_exists to exists
* refactor code and polish docstring
* fix windows ci
* add comment and polish docstring
* polish docstring
* polish docstring
* rename _path_mapping to _map_path
* polish docstring and fix typo
* refactor get_local_path
* add list_dir_or_file for FileClient
* add list_dir_or_file for PetrelBackend
* fix windows ci
* Add return docstring
* polish docstring
* fix typo
* fix typo
* fix typo
* fix error when mocking PetrelBackend
* deprecate the conversion from Path to str
* add docs for loading checkpoints with FileClient
* rename keep_log to keep_local
* refactor map_path
* add _ensure_methods to ensure methods have been implemented
* fix list_dir_or_file
* rename _ensure_method_implemented to has_method
* refactor
* polish information
* format information
|
2021-10-24 14:26:52 +08:00 |
|
Zaida Zhou
|
5b5b47fc87
|
[Feature] Loading objects from different backends and dumping objects to different backends (#1330)
* [Feature] Choose storage backend by the prefix of filepath
* refactor FileClient and add unittest
* support loading from different backends
* polish docstring
* fix unittet
* rename attribute str_like_obj to is_str_like_obj
* add infer_client method
* add check_exist method
* rename var client to file_client
* polish docstring
* add join_paths method
* remove join_paths and add _format_path
* enhance unittest
* refactor unittest
* singleton pattern
* fix test_clientio.py
* deprecate CephBackend
* enhance docstring
* refactor unittest for petrel
* refactor unittest for disk backend
* update io.md
* add concat_paths method
* improve docstring
* improve docstring
* add isdir and copyfile for file backend
* delete copyfile and add get_local_path
* remove isdir method of petrel
* fix typo
* add comment and polish docstring
* polish docstring
* rename _path_mapping to _map_path
* polish docstring and fix typo
* refactor get_local_path
* add list_dir_or_file for FileClient
* add list_dir_or_file for PetrelBackend
* fix windows ci
* Add return docstring
* polish docstring
* fix typo
* fix typo
* deprecate the conversion from Path to str
* add docs for loading checkpoints with FileClient
* refactor map_path
* add _ensure_methods to ensure methods have been implemented
* fix list_dir_or_file
* rename _ensure_method_implemented to has_method
|
2021-10-23 20:51:44 +08:00 |
sshuair
|
6719cde43a
|
add HTTP backend (#860)
* add HTTP backend
* add HTTPbackend
* fix linting
* fix linting
* add docs attributes http
* fix format
* add real http link test for http backend
|
2021-03-03 16:23:04 +08:00 |
Wang Xinjiang
|
c9f96855b0
|
Allow list index keys in Config.merge_from_dict (#696)
* Allow list keys in Config merge from dict
* Reformat
* Set allow_list_keys default as True in merge_from_dict
* Fix docstring
* fix a small typo
|
2020-12-08 17:17:27 +08:00 |
lizz
|
9f04477f93
|
Harmless changes (#340)
* harmless changes
Signed-off-by: lizz <lizz@sensetime.com>
* Update conv_module.py
* No bracket for simple class
Signed-off-by: lizz <lizz@sensetime.com>
|
2020-06-15 11:29:01 +08:00 |
Jintao Lin
|
5a98f7e421
|
enalbe memcached support in PetrelBackend (#341)
|
2020-06-13 18:32:48 +08:00 |
Kai Chen
|
213156cebb
|
Allow registering new backends with decorators (#307)
* allow registering new backends with decorators
* add a docstring
* minor update to the docstring
|
2020-05-31 21:56:03 +08:00 |
Jerry Jiarui XU
|
0946feabe3
|
add PetrelBackend (#294)
* add PetrelBackend
* update docs
* add path_maps for Ceph
* rename to path_mapping
* fixed import
|
2020-05-23 01:31:11 +08:00 |
|
Kai Chen
|
3bf3e8ef24
|
Revert "add PetrelBackend (#291)" (#293)
This reverts commit 7f80a2c6b9.
|
2020-05-23 01:07:43 +08:00 |
|
Jerry Jiarui XU
|
7f80a2c6b9
|
add PetrelBackend (#291)
* add PetrelBackend
* update docs
* add path_maps for Ceph
* rename to path_mapping
|
2020-05-22 12:31:34 +08:00 |
|
Kai Chen
|
e333d8222b
|
Add FileClient to access file from different backends (#237)
* add file client
* install missing requirements
* use .format() instead of f-string
|
2020-04-23 19:54:29 +08:00 |