c1712ee290
[Enhance] Add conf_path in PetrelBackend ( #2459 )
...
* feat: add conf_path in PetrelBackend
* fix: add conf_path in MockPetrelClient
* fix: adjust parameters order
2022-11-28 11:48:13 +08:00
cb781ae4ba
[Fix] Fix the problem that the instance cannot reuse when overwriting the file client. ( #1747 )
...
* [Fix] Fix the problem that the instance cannot reuse when overwriting the file client.
* Remove _overridden_backends and _overridden_prefixes, and pop the old instance when overwriting the file client.
* add unittest
* fix prefix error
* modify clear_backend to overridden_backend
* Delete redundant comments.
2022-05-25 19:34:15 +08:00
45fa3e44a2
Add pyupgrade pre-commit hook ( #1937 )
...
* add pyupgrade
* add options for pyupgrade
* minor refinement
2022-05-18 11:47:14 +08:00
6e9ce18323
Add copyright pre-commit-hook ( #1742 )
...
* first commit
* Add copyright pre-commit-hook
2022-02-24 09:24:25 +08:00
32e09f4933
[Feature] Upload checkpoints and logs to ceph ( #1375 )
...
* [Feature] Choose storage backend by the prefix of filepath
* refactor FileClient and add unittest
* support loading from different backends
* polish docstring
* fix unittet
* rename attribute str_like_obj to is_str_like_obj
* [Docs] Upload checkpoint to petrel oss
* add infer_client method
* Support uploading checkpoint to petrel oss
* add check_exist method
* refactor CheckpointHook
* support uploading logs to ceph
* rename var client to file_client
* polish docstring
* enhance load_from_ceph
* refactor load_from_ceph
* refactor TextLoggerHook
* change the meaning of out_dir argument
* fix test_checkpoint_hook.py
* add join_paths method
* remove join_paths and add _format_path
* enhance unittest
* refactor unittest
* add a unittest for EvalHook when file backend is petrel
* singleton pattern
* fix test_clientio.py
* deprecate CephBackend
* add warning in load_from_ceph
* fix type of out_suffix
* enhance docstring
* refactor unittest for petrel
* refactor unittest for disk backend
* update io.md
* add concat_paths method
* fix CI
* mock check_exist
* improve docstring
* improve docstring
* improve docstring
* improve docstring
* add isdir and copyfile for file backend
* delete copyfile and add get_local_path
* remove isdir method of petrel
* fix typo
* rename check_exists to exists
* refactor code and polish docstring
* fix windows ci
* add comment and polish docstring
* polish docstring
* polish docstring
* rename _path_mapping to _map_path
* polish docstring and fix typo
* refactor get_local_path
* add list_dir_or_file for FileClient
* add list_dir_or_file for PetrelBackend
* fix windows ci
* Add return docstring
* polish docstring
* fix typo
* fix typo
* fix typo
* fix error when mocking PetrelBackend
* deprecate the conversion from Path to str
* add docs for loading checkpoints with FileClient
* rename keep_log to keep_local
* refactor map_path
* add _ensure_methods to ensure methods have been implemented
* fix list_dir_or_file
* rename _ensure_method_implemented to has_method
* refactor
* polish information
* format information
2021-10-24 14:26:52 +08:00
5b5b47fc87
[Feature] Loading objects from different backends and dumping objects to different backends ( #1330 )
...
* [Feature] Choose storage backend by the prefix of filepath
* refactor FileClient and add unittest
* support loading from different backends
* polish docstring
* fix unittet
* rename attribute str_like_obj to is_str_like_obj
* add infer_client method
* add check_exist method
* rename var client to file_client
* polish docstring
* add join_paths method
* remove join_paths and add _format_path
* enhance unittest
* refactor unittest
* singleton pattern
* fix test_clientio.py
* deprecate CephBackend
* enhance docstring
* refactor unittest for petrel
* refactor unittest for disk backend
* update io.md
* add concat_paths method
* improve docstring
* improve docstring
* add isdir and copyfile for file backend
* delete copyfile and add get_local_path
* remove isdir method of petrel
* fix typo
* add comment and polish docstring
* polish docstring
* rename _path_mapping to _map_path
* polish docstring and fix typo
* refactor get_local_path
* add list_dir_or_file for FileClient
* add list_dir_or_file for PetrelBackend
* fix windows ci
* Add return docstring
* polish docstring
* fix typo
* fix typo
* deprecate the conversion from Path to str
* add docs for loading checkpoints with FileClient
* refactor map_path
* add _ensure_methods to ensure methods have been implemented
* fix list_dir_or_file
* rename _ensure_method_implemented to has_method
2021-10-23 20:51:44 +08:00
6719cde43a
add HTTP backend ( #860 )
...
* add HTTP backend
* add HTTPbackend
* fix linting
* fix linting
* add docs attributes http
* fix format
* add real http link test for http backend
2021-03-03 16:23:04 +08:00
c9f96855b0
Allow list index keys in Config.merge_from_dict ( #696 )
...
* Allow list keys in Config merge from dict
* Reformat
* Set allow_list_keys default as True in merge_from_dict
* Fix docstring
* fix a small typo
2020-12-08 17:17:27 +08:00
9f04477f93
Harmless changes ( #340 )
...
* harmless changes
Signed-off-by: lizz <lizz@sensetime.com>
* Update conv_module.py
* No bracket for simple class
Signed-off-by: lizz <lizz@sensetime.com>
2020-06-15 11:29:01 +08:00
5a98f7e421
enalbe memcached support in PetrelBackend ( #341 )
2020-06-13 18:32:48 +08:00
213156cebb
Allow registering new backends with decorators ( #307 )
...
* allow registering new backends with decorators
* add a docstring
* minor update to the docstring
2020-05-31 21:56:03 +08:00
0946feabe3
add PetrelBackend ( #294 )
...
* add PetrelBackend
* update docs
* add path_maps for Ceph
* rename to path_mapping
* fixed import
2020-05-23 01:31:11 +08:00
3bf3e8ef24
Revert "add PetrelBackend ( #291 )" ( #293 )
...
This reverts commit 7f80a2c6b9
2020-05-23 01:07:43 +08:00
7f80a2c6b9
add PetrelBackend ( #291 )
...
* add PetrelBackend
* update docs
* add path_maps for Ceph
* rename to path_mapping
2020-05-22 12:31:34 +08:00
e333d8222b
Add FileClient to access file from different backends ( #237 )
...
* add file client
* install missing requirements
* use .format() instead of f-string
2020-04-23 19:54:29 +08:00
SUNYC
Wencheng Wu
Zaida Zhou
sshuair
Wang Xinjiang
lizz
Jintao Lin
Kai Chen
Jerry Jiarui XU