summaryrefslogtreecommitdiffstats
path: root/recipes-kernel
diff options
context:
space:
mode:
authorBruce Ashfield <bruce.ashfield@gmail.com>2026-06-01 14:55:08 +0000
committerBruce Ashfield <bruce.ashfield@gmail.com>2026-06-01 14:55:08 +0000
commitc7dfb08a3e6c3b00a80dcd34b5b017e5d6c6b41e (patch)
tree8386c7486a887407daca609d658decd2ed3a6a6c /recipes-kernel
parent1a74ef81a72d7364dcc631a033976c3629059cb9 (diff)
downloadmeta-virtualization-c7dfb08a3e6c3b00a80dcd34b5b017e5d6c6b41e.tar.gz
ceph: update to v20.3.0-tip
Bumping ceph to version v20.3.0-8342-g6830c0390c2, which comprises the following commits: 314f25e2b00 os/bluestore: do not increment *issued_deferred* counter twice in write v2 mode. 4369bea1475 test/libcephfs: reduce SnapDiffDeletionRecreation bulk_count on Windows 6af1a859468 cmake: add WITH_SYSTEM_SPDK to link a system-installed SPDK d18ffa868fd blk/spdk: support both old and new spdk_env_opts member names 929679f7708 cephadm: cephadm: omit --osd-type classic for older ceph-volume 868fdd81207 rgw: move SWIFT error_handler out-of-line to fix link failure 7f8bcdc7d1f qa/suites/nvmeof: ignore "have only 1 nvmeof gateway" 0bf55d6a8bb qa/tasks: capture CommandCrashedError when running nvme list cmd 7004aa5a96d script/backport-create-issue: update custom field name 787f2b0d0a4 osd/scrub: removed a misleading comment about 'overdue' scrubs 86b52ecfefe nvmeof: Change the NVMEOF image version to 1.8 d91d320a7f1 ceph-volume: retry lvs after empty result and "devices file is missing" stderr eb3cf546ff7 mgr/dashboard: dont treat errno.EREMOTE as an error to avoid errors from listerner add command 142e167a4f6 doc/rgw: document s3control apis for PublicAccessBlock c03af0ba8d4 mgr/smb: fix incorrect referenced variable 143cb00ba14 doc/rgw: document support for bucket-level PublicAccessBlock 53a697880e5 mgr/dashboard: Add EC pools support to NVMEoF CLI Fixes: https://tracker.ceph.com/issues/76937 614993a066f qa/tasks/cbt: construct venv just for cbt e9ef70baca7 qa/distros: use consistent naming 17cc03da91c qa/tasks/nvme_loop: fix nvme loop task for ubuntu noble 04dd6dad278 qa/distros: add ubuntu_24.04 as supported container host cee6de8bf57 qa/distros: bump ubuntu_latest.yaml to 24.04 5231fd6079a qa/distros: add all/ubuntu_24.04.yaml 6532dd3c6f4 qa/suites/rados/encoder: use random supported distro 8c317411afb qa/ceph-ansible: symlink supported-random-distro$ 0948f5a91c2 qa/fs/fscrypt: symlink supported-random-distro$ f987d23d5a7 qa/cephmetrics: symlink supported-random-distro$ 28647966e2e mgr/ThreadMonitor: monitor interval running in seconds and not nanoseconds d8f566925fe crimson/seastore: segment_manager: fix -Wunused warnings 9d8d2e21da8 qa/suites/nvmeof: set beacon grace and connect panic 02e511c5d5d crimson/os/seastore: force rewrite transactions to conflict with others if it involve insertions on the lba tree eb433c57ead qa: ignore POOL_FULL for rbd tests exercising full pools ae1fee05818 mgr/dashboard: fix nested shell quoting in cephadm e2e start-cluster 24bf877c874 scripts: add Jenkins unit test analysis tool 44d810e305f rgw/s3control: skip account id check for admin users 4ac5a3210ae osd/scrub: 'repairing' scrubs allowed at all times 715cb60777b crimson/os/seastore/onode_manager: avoid debug related info from occupying too much cpu time c76e03405d7 doc/PendingReleaseNotes: document osd_scrub_queued_snaptrims_limit fe7e0d3b2fd crimson/os/seastore: auto-tune cleaner gc segment pick under random-write 6ff6a5572e9 qa/rgw/bucket-logging: configure STS for assume-role test b7eace1619d crimson/os/seastore: also update the mappings copied by client transactions when committing background rewriting transactions c5cb9222c47 crimson/os/seastore/omap_manager/log: better output 6d19e4618c9 doc/dev/crimson/seastore_laddr.rst: add descriptions about temp recovering objects ab20e12e130 crimson/osd: treat OI-not-existing cases as enoent 5111b45f068 crimson/os/seastore/object_data_handler: new debug logs 25c4baa2be7 crimson/osd: create temp recovering objects through touch_temp a0ea1702577 crimson/os/seastore: handle OP_TOUCH_TEMP 077fe0d20f0 os/Transaction: add the interface dedicated to touching temp objects 57e94ba7e25 crimson/os/seastore/lba: fix possible namespace lookup error 0e58ce44a09 dev/doc/crimson: clarify dynamic PG and object bits for static laddr design 2ffcc866075 crimson/os/seastore: adapt copy on write for static onode prefix 1aa88f34e74 crimson/os/seastore: support rename for static layout of laddr e604b4f1895 crimson/os/seastore: add "move_mapping" to TransactionManager and LBAManager 7d980e2f4dc crimson/os/seastore/lba: set extent type for ZERO lba mappings de23df56d10 mgr/dashboard: Add Hosts via CSV Upload 54d3b933ba6 workunits/mgr/test_mgr_modules_perf_counters: new test for enable\disable\perf counts 95a90f7da8a mgr: Add per-module performance counters to mgr a785b5f561e Use GANESHA_REPO_BASEURL for NFS-Ganesha on all distros 4a405a877b9 ceph-volume: OSD mapper lifecycle (LVM + raw) for activate 355872641a3 rgw: bump Apache Arrow submodule from 17.0.0 to 19.0.1 b1632262603 crimson/os/seastore/lba: fix wrong asserts and "if" conditions 618d7e23325 crimson/os/seastore/OMapManager: only store the relative block offset to omap root in OMapInnerNode 1bab3d4e518 test/crimson/seastore/test_btree_lba_manager: add test cases for conflict policy abcb6853846 crimson/os/seastore/lba_manager: implement conflict policy 1ff54b89390 crimson/os/seastore: reserve region in LBABtree when touching onode 56e511d0064 crimson/os/seastore/OnodeManager: adapt laddr_hint_t approach f82377b90c6 crimson/os/seastore/OMapManager: adapt laddr_hint_t approach d4943a95def crimson/os/seastore: use laddr_hint_t to allocate the laddr a024be2c5d7 crimson/os/seastore/Onode: get sibling's object id when creating new onode 9fa0f4e9832 crimson/os/seastore/Onode: adapt new get hint approach c6022c32293 crimson/os/seastore/Onode: support get object/clone prefix a800f4072a8 crimson/os/seastore/Onode: remove default metadata offset/range e3100b7457b crimson/os/seastore: introduce laddr_hint_t and associated factory methods c9e62b62531 crimson/os/seastore: make pladdr_t only store the local clone id instead of full laddr_t 4c6f72aaaf9 crimson/os/seastore: introduce static layout of laddr_t a72adaa9444 crimson/os/seastore: extend the size of laddr_t from 64 bits to 128 bits 60acfdd102f crimson/scrub: fix assert in PGScrubber::release_range() on interval change 591d8ac3748 feat(rgw/kafka): add mTLS client certificate authentication for Kafka notifications Add support for mutual TLS (mTLS) client certificate authentication when publishing bucket notifications to Kafka brokers. RGW can now present a client certificate and private key to authenticate with brokers that require ssl.client.auth=required. Changes: - Add ssl-certificate-location, ssl-key-location, and ssl-key-password topic attributes for configuring client certificates - Validate that ssl_certificate and ssl_key are provided together - Include ssl_key_password in connection identity (hash/equality) - Add kafka-security.sh script for generating broker and client TLS certs - Add mTLS test (test_notification_kafka_security_ssl_mtls) using use_mtls=True flag on the existing SSL security path - Update RGW notifications documentation with mTLS parameters 16b7a0b0f67 mgr/cephadm: adding UT for the new functionality ce809678373 mgr/cephadm: moving certificates reconciliation code to a new method a1430973f2c qa/suites/upgrade: ignore osd in unknown state 873f1240775 test/bluefs: introduce FileWriter UT 7e12195bf70 os/bluestore/BlueFS: Simplify flush functions d4380780b83 os/bluestore/bluefs: Simplify flush procedure 4ade51483a3 crimson/os/seastore: drop RetiredExtentPlaceholder f781eeaa8e3 crimson/os/seastore/cache: remove retire_extent_addr bf32dac1867 crimson/os/seastore/cache: re-implement Cache::retire_absent_extent_addr 27794c343dd osd/scrub: limit scrubbing under snap-trimming overload 5e4908a02d8 crimson/osd: collect total snap-trim queueus length 5e689b56a19 osd: collect total snap-trim queueus length c5afb3a61d9 qa/rgw: ignore 'keytool: command for found' errors 17dca0d8dd7 mgr/dashboard: add telemetry status to overview-health-card d63de6769f1 os/bluestore/bluefs: Make FileWriter::pos private e941e893181 common: enable AVX512+VPCLMULQDQ for crc32c performance on x86 6f35766bc07 Revert "Merge pull request #67999 from Shubhaj1810/nfs-ganesha-servicemap-fix" 1854995dce3 rgw/logging: use assumed-role ARN as Requester for STS requests 6619587dc27 Revert "Use GANESHA_REPO_BASEURL for NFS-Ganesha on all distros" 4ecaf8a4cd6 rgw: simplify GCM key cache, IV layout, and endian encoding fcdc01a1a03 rgw: write RGW_ATTR_CRYPT_PREFETCH_ALIGN for AEAD ciphers 87c7c45ea6a rgw: add range projection helpers for encrypted and compressed objects e7925772ee9 rgw: use stored plaintext size for AEAD segment validation 7e646e0633b rgw: add benchmark for GCM and CBC encrypt/decrypt throughput 5e7a78180df rgw: replace GCM nonce with salt-based key derivation d651201a90b rgw: use bucket_id instead of bucket name in GCM key derivation a8ed43bfc05 rgw: optimize GCM encrypt/decrypt hot path 888c323ad35 qa/rgw: test GCM encryption in existing crypt and multisite suites 7b7aceb16f3 rgw: add GCM hardware acceleration support via CryptoAccel dfdbb84a19c rgw: add AES-256-GCM (AEAD) support for server-side encryption d524934dd3a qa/openssl-keys: enable wildcard dns with subjectAltName 249999df6fa qa/rgw: RGWEndpoint.url() contains dns-name if configured 0567c5049f1 qa/rgw: add s3control subsuite 0cffed8623f qa/rgw: s3tests task configures account ids 8924fe65f8f rgw: add s3control apis for PublicAccessBlock 8bdd10a9ea6 rgw/s3: apply vhost logic to s3 only d4b5a2bcc80 rgw/rest: use ceph::split() for rgw_enable_apis 3712f84998f rgw/rest: add RGWRESTMgr_S3Website b4ec80fa1b8 rgw/main: clean up use of rgw_enable_apis 7d836abcbfa rgw/iam: add s3:Get/PutAccountPublicAccessBlock actions 8566ec987c7 rgw: enforce BlockPublicAcls on CreateBucket 4bdc679b97c rgw: add helper for bucket + account PublicAccessBlock config 8ad325939eb rgw: req_state::public_access_block is not optional 553fd26f391 rgw: PublicAccessBlockConfiguration as raw struct dceaea6c420 rgw/s3: rename req_state::bucket_access_conf to public_access_block 2aac01b34f1 rgw: add s3control by default to rgw_enable_apis 61b6d722260 rgw/datalog: DataLogBackends::trim_entries: fix crash when target_gen > head_gen a323441c65c test/rgw/datalog: test for trim_entries with max_marker 4c5f4df9e22 rgw/datalog: also handle errors properly for fifo trim 9f8642bbd63 crimson/osd: use store-specific max_object_size for the OSD-layer write check 3992ec54af3 crimson/osd: only unblock wait_for_active_blocker on replica when ACTIVE df3e1e63523 crimson/osd: wake pgs_creating waiters in PGMap::pg_loaded() b83a20a2fc2 crimson/seastore: reject oversized writes and zeros instead of aborting 8297ead0e24 crimson/osd: call pubsetbuf() before open() 16e54fa7217 doc/man: fix broken markup in cephadm.rst c5a73aaf761 doc/rados: move label to right place in pools.rst 68896302163 crimson/osd: decouple snap trim initiation from scrub completion d2fa262a64d common/options: improve rgw_dns_name and clarify separator a47da78c0dc crimson/seastore: clamp block_size to laddr_t::UNIT_SIZE on small-LBA devices 7bb4a76a81e neocls log trimming (time based): fix infinite loop on ENODATA e1a6ed169dd neocls log trimming (marker based): fix infinite loop on ENODATA 97e7646799f script/ptl-tool: allow automatic links for commit sha 027a609a827 mgr/DaemonServer: auto-tune stats period when message queue gets backed up 36740460c19 .github/workflows/releng-audit: update python to 3.12 7e3b5fe5f94 .github/workflows/releng-audit: update workflows 25448c21167 debian/rules: strip ceph-osd-classic and ceph-osd-crimson 154cf3271e2 mgr/dashboard: fix remaining FA icon references and test failures a80c727c5db mgr/dashboard: fix filter icon alignment in table toolbar 10ec25edba9 mgr/dashboard: fix missing loader and zone group icon 8b94da6a7c3 mgr/dashboard: update health-icon pipe tests for Carbon icons da27d0806d4 mgr/dashboard: replace icons.spin with Carbon loading components 8f9abc8f838 mgr/dashboard: replace fork-awesome size classes with Carbon sizes 3c54ee6992e mgr/dashboard: remove fork-awesome package dependency a37bd5ba0ad mgr/dashboard: remove font awesome references 91090ee16a3 doc/dev/internals: Improve Ceph Internals TOC e6d22f24473 osd: Change tabs to spaces in _merge_object_divergent_entries f4237ca47e0 osd: Divergent logs for pure partial writes should roll back mising list when merged. 1f1a31e6dd0 mgr/dashboard: carbonize RGW overview dashboard 59d705b3ab0 rgw/dedup: dedup-filter - add empty-file validation, fix dump default param, fix typos b5ab8c5d209 mgr/dashboard: fix tag colors not applied in table cells 475cdecaf4f script/ptl-tool: use provided base even in conflict b5ea41c15af doc/start: Clarify doc building and begin list of conventions 4507543bead mgr/dashboard: fix build and test failures from ngx-toastr removal 6ee719a2716 rgw/dedup: fix negative errno codes in filter and radosgw-admin e9f603f8ace rgw/dedup: add --allow/deny-bucket-list and --allow/deny-storage-class-list to dedup commands Resolves: bz#2413730 Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com> d91bd72f1b8 librados/asio: clear cancellation slot in associated executor 27bbb966dd6 librados/asio: extend lifetime of AioCompletion b426b02c29d mgr/dashboard: Remove `ng-click-outside` and `ngx-toastr`package c03a021f248 doc:crimson-dev: add RANDOM_BLOCK_SSD usage example, fix indentation e2ce11d9da1 cephadm: disable UDP in samples/nfs.json for test_cephadm Ganesha test_cephadm.sh deploys NFS through cephadm _orch deploy using src/cephadm/samples/nfs.json. That sample is separate from the mgr ganesha.conf.j2 template, which already sets Enable_UDP = false. Without that setting, Ganesha on Rocky 10 (ceph-ci image) fails during startup with "Cannot register NFS V3 on UDP", so test_cephadm.sh never sees ganesha.nfsd listening on port 2049. Add Protocols = 3, 4 and Enable_UDP = false to NFS_CORE_PARAM so the sample matches the orchestrator defaults. Fixes: https://tracker.ceph.com/issues/76295 Signed-off-by: Kobi Ginon <kginon@redhat.com> 06800d9655d crimson/os/seastore: yield to user IO between cleaner cycles c53bacdbcc2 crimson/os/seastore: fix IO-block deadlock when cleaner is sleeping e4793f12a60 mgr/dashboard: Remove cephfs mirroring navigation from Umbrella 963c830f9d8 mgr/dashboard: fix logs e2e tests after carbonization fae92b5eed2 Revert "mgr/dashboard: set up dashboard as a app shell" e8be7aabbfe Revert " mgr/dashboard: add rollup as optional deps" 346e04abcde mgr/dashboard: remove unused upgradable component e20c6d82e32 mgr/dashboard: carbonize logs component d19d9e45fac mgr/dashboard: Carbonize upgrade page 5cb4c1cd3da mgr/dashboard: NFS enhancements - terminology alignment cc915db2269 mgr/dashboard: Fix mon_allow_pool_delete unit test ac7fd7d5150 mgr/dashboard: Fix edit and delete access for pool-manager role 625f6baeb03 cmake/BuildISAL: build and install library targets only cc0dc343a48 crimson/osd: complete PGAdvanceMap's pg-deleted path properly 9905c13b2d6 crimson/osd: remove unnecessary 'using cached_map_t' 1c891080274 crimson/osd: coroutinize PGAdvanceMap::start() 2520e0b0bfd crimson/osd: make PGAdvanceMap idempotent 15ca5d7ab9c mgr/dashboard: Replace htmllint with Prettier for HTML linting 36d26839b4e crimson/os/seastore: fix cleaner space leak from shadowed result list 41c141e416b .github/workflows/releng-audit: group events to serialize executions ff0cbcd74c9 .github/workflows/releng-audit: remove override on reopen 80141b25d42 .github/workflows/releng-audit: refactor auth check to function 7f739adae21 crimson/os/seastore: use configured device type to select segment manager 019ee27f602 doc/dev: refresh vstart.sh options in dev_cluster_deployment 2746a9b7c9d src/cephadm: added ceph-exporter to post-rotate signal list 86dd63ca5f3 qa: ignore expected OSD_ROOT_DOWN 14653b576a6 qa: ignore fs offline warning fbe46ce71be qa: add MDS_INSUFFICIENT_STANDBY to ignorelist b2ac7f65613 qa/suites/upgrade: use common ignorelist daa0a2f018e cephadm: fix mgr ports list growth; add unit tests (#76564) ce5882778db osd: Fix bug when calculating min_peer_features c62f537f2c9 rgw/beast: add ssl_ciphersuites option for tls 1.3 7cdb7edad4a doc/rados/configuration: recommend wpq for EC clusters seeing slow ops 042f3cbe01a qa/crimson: disable test-coredump 307244b02cf qa/crimson: add coredump generation test using ASOK assert e9a9590a136 crimson/osd: support the Assert test ASOK command 34015582721 doc/dev: fix release cycle diagram and missing text c1e3f71064f script/ptl-tool: consolidate conflict reviews 31bc2a735dc .github/workflows/releng-audit: handle missing case of skipping audit on override 51a4d6e1c1b rgw: group lifecycle versioned deletes to reduce OLH contention 6fdacbc3e5d mgr/dashboard: adding daemon_name as an arg to nvmeof get bundle API 32f7dfff527 rgw: extract multi-delete OLH grouping for use by lifecycle a036f77654d cephadm: mgr prepare_create must replace ports, not append 6baf24a9378 .github/workflows/releng-audit: reuse existing redmine secret f1dc8a2063c .github/workflows/releng-audit: consolidate into single job 93ba2d61bef .github/workflows/releng-audit: handle simultaneous override and fail label changes e7c553b0871 qa: ignore pg stuck peering 1163bd6b015 Use GANESHA_REPO_BASEURL for NFS-Ganesha on all distros dacad7377a9 mds/ScrubStack: set added_children to true for dirfrags too 7f9605852f9 mgr/cephadm: fix get_cert_with_label to use host instead of fqdn 02b4fe84523 mgr/cephadm: adding UT for this new functionality (leftover cleanup) 13df667f406 mgr/cephadm: cleanup leftover certs/keys after cert_src changes d3f3bcbcf42 mgr/cephadm: adding tls fields as deps for services with TLS support 5823feb82e2 mgr/dashboard: Carbonize cluster-wide OSD flags modal fixes:https://tracker.ceph.com/issues/76580 Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com> f387d0acbca os/bluestore: add effective elastic shared blobs mode into OSD metadata 322e78c1ce4 qa/suites/upgrade: ignore undersized PG during stress splits ad6f20fde54 qa: ignore cephadm failed daemon warnings during thrashing cf58f1be25a osd/test: Fix build breakage when WITH_EC_ISA_PLUGIN is OFF 179e9bd3296 mgr/cephadm: serialize OSD class before returning for OSD rm status 572e3f1666c doc: Updated the doc for NFS colocating ports b1d9eba3df8 crimson/osd: fix crash in committed_osd_maps when an OSD is removed 1c5a7395776 pybind/mgr/status: drop asserts that fight the defaultdict defaults 5722e489f8f mgr: narrow get_metadata return type with @overload da4b361e63c mgr: Control PG autoscaler during upgrades with pg_autoscale_during_upgrade 1d09118286a crimson/osd: disable ofstream buffering to fix concurrent logging 3308b63c29c crimson/osd: inline log file stream setup to fix dangling pointer 25865863f8e crimson/osd: drop redundant trailing co_return in pg_advance_map fe1a5a585a8 test/neocls/log trimming: reproduce log trimming can go into an infinite loop b4f3de72ac6 osd/test: Fix build breakage when WITH_EC_ISA_PLUGIN is OFF d3ead6e7a1b mgr/volumes: reduce noisy health check logs a75d42acb06 python-common/drive_selection: keep existing-OSD devices past limit 5f8a4de52a8 ceph-volume: tolerate <=1% short-fall on requested db/wal size 5a52afc701e ceph-volume: allocate db/wal slot on partial fast-device VG 906dba604de doc/rgw: warn about rgw_usage_max_shards consistency 88d4c1ce122 debian: drop explicit libprotobuf dependency from ceph-osd-crimson 2eb19f35e33 mgr/dashboard: Updates to empty state component c259c6f3fcf mgr/dashboard: Update cypress dashboard e2e tests bd77c67ae70 mgr/dashboard: Allow checks for prometheus disablement 978b6c20350 mgr/dashboard: Fix cephadm e2e tests 0fb99092ef2 mgr/dashboard: Fix creat-cluster welcome tests 492d1a023d9 mgr/dashboard: Fix overview a11y tests 626e7872e98 mgr/dashboard: Fix a11y tests of navigation 50cf5f2a5e0 mgr/dashbaord: Enable overview landing page a32fe1e8e0e mgr/nfs: reuse CephfsClient for path checks and earmark resolver 988b68995ed crimson: consolidate the return paths of get_segment_manager() f9acf620bb2 crimson: abort on ioctl(BLKGETNRZONES) failure f8cde1e00fb crimson: use uint32_t when calling ioctl(BLKGETNRZONES) 458368c1b88 crimson: coroutinize SegmentManager::get_segment_manager() de2cbe61ee7 docs/security: added workinggroup.rst and securitylead.rst Signed-off-by: Sage McTaggart <sagemct@ibm.com> 062ec6fedde mgr: add prerequisites check before enabling dashboard oauth2 sso b3c35bc4197 src/test/mon: test_monmap_monitor.cc d52cfb50ddd doc: update stretch-mode.rst aa9e1dad056 mon: make tiebreaker mon optional in stretch-mode 654553677cb qa/cephadm: start upgrade tests from tentacle instead of reef on main 3dbbe15d001 Crimson/QA: add crimson-fixed-2-mem32g reduced-memory cluster variants 4ff4fb50b6a crimson/osd: add crimson_memory config option 000355d2da1 script/ptl-tool: continue adding conflicts to review when interactive 689e9875468 script/ptl-tool: improve wording for rationale requests 3512a409b0d script/ptl-tool: refactor verify_commit_parity 3b60217b9bc script/ptl-tool: replace gitauth redirection 0a54fcdfc49 doc: document the releng-audit workflow and update release examples 489f70e8dff script/ptl-tool, actions: introduce event-driven CI backport auditing 922f0c62f5e script/ptl-tool: introduce interactive backport parity and conflict verification 2eedf1dcbc2 script/ptl-tool: use Authorization header 64b2f85f21f qa/suites/crimson-rados/rgw/sts/tasks/1-keycloak: dont install java-17-openjdk-headless d63d2bfe589 mgr/dashboard: fix missing claims on oauth2 sso 36065111dac mgr/dashboard: raise exception on oauth2 sso expired token dee19fec702 crimson/osd/snap-mapper: flush pending writes on pg interval change 854e83b2f0c doc/rados: warn against lowering require_min_compat_client in read-balancer 4c3f4efa340 os/bluestore: check unshare blobs during snapshot deletion and fix unshare logic. 0581b8986e6 os/bluestore: add fsck_with_stats to run fsck and return stats dd434b7e425 rgw: Work around Boost.Containers bug in 1.91 fad8e86eb26 rgw/d4n: fix deprecated async_run overload in RedisPool bbd0a68b8f8 rgw: fix build with Lua 5.5 d97b7ccf77e common/admin_socket: use POSIX timer for delayed signal delivery 6668ae20239 crimson/osd: skip PGAdvanceMap on a deleted PG d558a93eb27 mgr/dashboard: Allow quick bootstrap script to use custom images d599bd174cb msg/async/Protocol: include cleanup 6fdf2f9dc2b msg/async/AsyncConnection: include cleanup 32962c8b904 msg/Connection: include cleanup 6812fa2dc68 mon: add missing includes b381add9188 mgr: Accept only osd daemon type for bucket params to adhere to upgrade sequence 4dfa47e2e12 include/cpp-btree: fix false -Warray-bounds in child accessors ee03a51978c doc/rados: add kernel client notes to require_min_compat_client 73fdf19fdcd qa/suites/upgrade: ignore PG_DAMAGED 52064031dc0 debian: package manpage for cephfs-top 403be2a0ef2 doc: Clarification of text in ec stretch cluster design 115cb41e743 crimson/osd: acquire throttle when scanning replica/primary for backfill 7c6555c6d45 crimson: add missing includes 6c1a17b666e monitoring: Fix application overview to show Raw used 8d0cd56e99a rgw: fix frontend crash in abort_early() on client disconnect 9b49d290309 doc/governance: remove Sam from CSC 09131fb3264 doc/governance: remove Ken and Jeff from CSC 6396ecc8a82 doc/governance: update Ceph Executive Council List dceaf47d633 doc: document new options for smb share rm and cluster rm d4528552285 mgr/smb: add test cases for cluster rm w/ wildcard/recursive f2e250981bf mgr/smb: add --wildcard and --recursive to smb cluster rm ee6ebce693d mgr/smb: add unit tests to verify deleting shares by wildcard 6eb0a13a061 mgr/smb: add a --wildcard option to the smb share rm subcommand 5280f2851eb mgr/smb: add a new error type to reflect non-matching inputs 748bd8962e4 mgr/smb: add glob style wildcard support to matcher object 1a7843e9a3a msgr/async: make msgr_active_connections counter a gauge 92ead705db8 ceph.spec.in: add new --with pypkg to be passed on to cmake 5f270a9f6ff python-common: update CMakeLists.txt to optionally use new packaging c81fc975f71 src: add a new cmake flag WITH_PYPKG b5b32d3abac python-common: add a pyproject.toml file 42ddb5eafd5 cmake/modules: add PythonPackage.cmake d93755c3d8d ceph-volume: fix argparse dmcrypt opts: use str type 1b4e846c6c7 mgr/cephadm: fix prometheus redeploy stuck in loop 5bf5bc69ddf cmake: Fix ISA-L build on arm 4ebd2276bf4 mgr/dashboard: "Access Denied" being shown on overview page for read-only user Fix: https://tracker.ceph.com/issues/76293 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 254650b7088 osd: Fix incorrect rollback logic for partial write OI 5994e2a7faa osd: Avoid assertion on empty object read when reading multiple objects cced7e5701b ceph-volume: fallback to default for empty get_file_contents values 88c12f20895 librbd: add missing includes 1c8d6876b1a test/osd: add perf test for calc_pg_upmaps with mutual overfull upmap pairs 2ba9e1da7c3 osd/OSDMap: skip upmap-items drop when um_from would become equally overfull 5088bfe2a8f qa/distros/crimson-supported-all-distros b6d39ff0a9d crimson/osd: defer snap trimming while scrubbing 52f862cebbc osd: Use coroutines to perform synchronous reads in EC without blocking any threads d41db7301e2 osd: Adjust lock type selection in PrimaryLogPG::get_rw_locks e5e9aadc803 script: move llvm.sh logic to a function 61e0fcefbb9 script: remove call to set ccache option run_second_cpp bbaca737336 script: allow lib-build compiler function to find newer clang versions b9d9529553b do_cmake: support the ubuntu 26.04 version of python in build script e16cd9342ca debian: remove xmlsec1 deps from control file c9cca3ad821 script/build-with-container: add distro references for ubuntu 26.04 9fa5e520f1a crimson/os/seastore: implement OP_MERGE_COLLECTION 59dd31b71a5 crimson/os/cyanstore: implement OP_MERGE_COLLECTION 96f280b652f crimson/os/seastore: handle enoent in SeaStore::Shard::stat ac06cb5a959 osd/SnapMapper::update_snaps() to handle a missing OBJ_ record 92237ee4846 mgr/dashboard: Allow empty port value when adding a listener in NVMEoF CLI Fixes: https://tracker.ceph.com/issues/76410 0ee6b7e4abd doc: warn against default cephadm shell for ceph-volume 43bf8f21ecc mgr/cephadm: allow nvmeof group assignment for NVMe-oF services a50b342c769 rgw/test: add Journal mode support to bucket logging test suite a0e6c3b075e mgr: change cleanup and scanning cephfs connection logs to be less noisy 038b6df0cad rgw: fix assert crash in RGWDeleteMultiObj end_response() f90b4dcf23a doc/crimson/seastore: document device super-block structure 78e5167e505 mgr/orchestrator: reject spec-file input for oauth2-proxy apply 8122f820d74 cephadm: improve oauth2-proxy validation error messaging 257a357b691 aio_cxx: resolve test unreliability 9da2d94dd46 aio_cxx: Fix mutual deadlock in PoolEIOflag test 3cf0d17d076 doc/mgr/smb: document cluster QoS update command 078151a3eda mgr/smb: add cluster-level QoS update command for CephFS shares 8141b3f60a9 mgr/cephadm: mgmt-gateway bind to virtual_ip f3c932503e4 mgr/dashboard: raise an error in case invalid server-address was provided in nvmeof cli/api eae6ee94c88 seastore/omap_manager/btree: change omap manager funcs to coroutines fee0eaaa67d seastore/omap_manager/btree: change node insert/del funcs to coroutines a77af14dd75 mds: remove duplicate context completion calls 02735a362c6 mds: add retry request to MDSRank wait queue rather via finisher 66abd9a13f6 mds: adjust scan_stray_dir after fixing up MDSContext class 71c7be41b52 Revert "mds: move MDSContext completion handling to finish method" d45d149b004 osd: Split counter for stats invalidations so we can more accurately identify the causes of frequent failures more granularly. ccbeb980515 osd: Reduce the amount of status invalidations when rolling shards forwards during peering 14957354d71 mgr/cephadm: redirect browser to correct port by identity provider c3f7797a017 qa/rgw: add teuthology support for target_by_bucket cloud transition e46cfff13a7 test: Add help to ceph_test_rados f7d184d64e4 docs: Add documentation for ceph_test_rados 0c891f1d00d rgw: Move declaration inline to solve compiler warning about an unused variable. 55d81950046 cephadm: update NFS scheduling and ingress tests for CEPH block changes 4759cad91c5 cephadm: fix upgrade order validation when using --daemon-types with --hosts 4760facb40a mgr/cephadm: fix upgrade order validation when using daemon_types with hosts ad0d555a5ac sestore/omap_manager/btree: prevent heap buffer overflow in log f827e4dafc5 osd/scrub: auto-correct accounting-only stat mismatches 3ba0aba5938 rgw/cloud-transition: yield in cloud_tier_bucket_exists HEAD 652a9ba8c52 rgw/cloud-transition: check bucket existence before create 6ca1db424c6 rgw/cloud-transition: add per-bucket target options 7967f28c774 osd: PGLog Attach correct version to missing list when ignoring log entries d6b2c448857 osd/test: Add EC peering test infrastructure and recovery test cases ad50013d874 doc/start/os-recommendations: update for Umbrella and future releases 239821b1ebc mgr/dashboard: Bump lodash 7b2b62dcfcd mgr/dashboard: add remote write section to prometheus configuration 297279dce3e rgw/notifications: relax topic names validation 1737d7e8669 crimson/osd/pg: unify the current should_send_op method implementation 7839519a18c rgw/multisite: concurrency adjustment - consider the case caller provides 1 1d52ad32753 rgw/multisite: log concurrency state transitions in adj_concurrency 0c6e2269b53 script/ptl-tool: source githumap from main branch c12030f5e94 doc/cephfs/fs-volumes.rst: Correct volume creation with pre-existing pools 699b387b454 orch/cephadm: fix redeploy --force, validate container image ref 824514e49a4 rgw/multisite: fix uninitialized LatencyMonitor average and use exponentially weighted moving average eb42801b6f0 rgw/multisite: expose lock latency as perf counter for data sync b8a4f8217bd python-common/service_spec: fix style in hostname normalization changes e5824e94430 python-common/service_spec: simplify hostname normalization in HostPlacementSpec 3ec6b956d8c crimson/os/seastore: destroy Transaction only when no other reference exists ab7015c693a ceph-volume: make TPM2 PCR policy configurable (default to PCR 7) f476cd5994c mgr/dashboard: Update permissions for pool-manager role 1c4c066b55e mgr: ok-to-upgrade doc review comments fixed 56f710a6178 doc/rados: Fix spelling errors (3 of 3) 71a5a6f3fb8 ceph-volume: raw activate should ignore lvm backed OSD devices afb252a164a mgr: ok-to-upgrade added code comments for flow clarity 2614c078bfc mgr: ok-to-upgrade doc only review comments 97dd1d9a31a mgr: ok-to-upgrade review comments for dataclass etc 9cb9e9ff7e7 mgr: Bucket scoped OSD upgrades using ok-to-upgrade 8d21ac4b8da rgw: add RestoreStatus support to object listings a139f6694aa script/ptl-tool: allow PR numbers as GH urls bc42ec6c4b6 script/ptl-tool: get git dir via git command f2916e488da crimson/seastore: fixing some 'unused' warnings e6db4be354b mgr/cephadm: replace md5_hash with FIPS-safe config_hash b88339b4036 doc/rados: improve troubleshooting-mon.rst 598e335af71 mgr/dashboard: Fixed modal forms background color e06072b7d90 mgr/dashboard: Fix grid issues in notifications page and password form 2f37d895aa9 mgr/dashboard: Add gray10 theme base color to all pages 5791497c38b mgr/dashboard: Add gray10 theme background to overview and rgw page e06ec722db7 mgr/dashboard: Remove dashboard overrides 7bacebbb69c mgr/dashboard: Remove modal defaults 18d625ee351 mgr/dashboard: Remove tooltip and popover defaults e4926c1dadd mgr/dashboard: Enable gray 10 theme as per carbon standards 19b60ccb4e5 mgr/dashboard : Fixes EC profile used pool empty fixes : https://tracker.ceph.com/issues/76288 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> d2ef68b3e3f mgr/cephadm: log full tracebacks for upgrade exceptions 1817c0a1454 crimson/qa/objectstore-tool: reduce segments size 5c3a4a17baf qa/tasks: add timeout to 'GC' ceph_objectstore_tool calls 8ef4aacfcf7 qa/tasks/ceph_objectstore_tool.py: add gc_before_restart option c938fb306ce crimson/tools/objectstore: add GC operation to crimson-objectstore-tool e3347747f02 crimson/os: add GC operation to Seastore 523c3a22124 mgr/cephadm: Skip RDMA device check for NFS during upgrade 45c5d1f7e19 script/ptl-tool: add option to not create a tag 27e20dda540 rgw/lc: drop per-bucket LC counters to PRIO_DEBUGONLY 6c242eb6480 mgr/cephadm: remove SSH error logs from health detail when host is unreachable 7c6ea18d6e0 mgr/dashboard: use cephadm root CA for RGW SSL and improve error handling 0c145533405 cephadm: replace call_throws with call in command_inspect_image b0a98f1b3ef cephadm: convert lists back to tuples when loading last_client_files 55ed85efdfa mgr/cephadm: Handle daemon colocation port for cluster qos port 58b57f8713e mgr/cephadm: Fixed scheduling test for nfs qos port ca4a1249d3f mgr/cephadm: For colocating nfs daeoms, check daemon qos ports instead of fetching port from spec 99b2729b5eb mgr/nfs: 1. Removed the option to enable and disable cluster wide qos, it will be enabled by default 2. Removed the cluster_enable_qos field from the cluster-level block as it was causing confusion for the user. 3. Instead of using cluster use global while showing cluster level qos values in export qos get b8cf02130ea mgr/nfs: Update cluster qos_type from int to str eeb334fcd75 mgr/cephadm: support nfs cluster level qos Added below CEPH_NODES_LIST block in ganesha.conf and enable_cluster_qos in cluster level QoS block CEPH_NODES_LIST { Ceph_Nodes = 192.168.100.100, 192.168.100.101, 192.168.100.102; } f9703ada54c mgr/cephadm: NFSSpec changes to apply cluster level QOS while nfs service creation 3cdfbdc4f76 mgr/nfs: update QOS minimum BandWidth value and IOPS max value 22c24c4fe59 mgr/nfs: Changes for get QoS command to return bandwidth in GiB instead of GB f54ce5329e0 mgr/nfs: Changed IOPS max limit to 409600 and Bandwidth max limit to 100GB 8892c0ff5e6 mgr/nfs: Addressd review comments ddce67a5be4 nfs/mgr: Updated logs and exception messages c9ba6f3f3ec mgr/nfs: Added skip_notify_nfs_server parameter to update export commands e4c7a8782f7 mgr/nfs: When cluster level qos is disabled and export still has qos parameters, then allow nfs export apply command if file has same qos block which is already set 8acf8ce64a0 mgr/nfs: Add cluster level qos status to export get qos command b383a6779f9 mgr/nfs: Updated get qos to return bandwidth in bytes as dashboard needs bw in bytes 46cde5b7589 mgr/nfs: Updating QoS min and max limit of bandwidth and iops values 8db7c50e5cb mgr/nfs: NFS cluster and export commands to enable and disable ops/s control f43262d8eb6 mgr/nfs: NFS commands to enable, disable and get QOS config for cluster and export 2e743c3c2ad mgr/cephadm: Handled stick table for ipv6 setup, also removed stick table expiry 2a6d9f44abd mgr/cephadm: Update haproxy.cfg template to support nfs active active deployment a1987031815 rgw/lc: add per-bucket lifecycle performance monitoring eaf1f8d80c8 osdc: add missing include 33e3c8560c7 qa: Port rgw lifecycle test to crimson-rados 8291359b8a9 crimson/admin: avoid pg asok crashes 967b9711245 qa/crimson: add pg subcommands workunit 9bc8f3fcfd1 qa/suites: add crimson pg-subcommands suite e27af4a5ea9 qa/standalone: Add pg_subcommands test c5ebbd2443f crimson: Add missing pg subcommands a95886b8bb3 crimson: add pg subcommands support in CLI f510ed3a8bc doc/rados: document require_osd_release be0fc7e03d0 doc/rados: document require_min_compat_client f0f85f09cc2 doc: document ceph nvmeof CLI subcommands for target configuration 280a3b0c6ce test/rgw/kafka: make batch size tests manual 3b0171e0b17 rgw/kafka: setting maximum batch size when sending messages 42b648ebf20 qa/lsan.supp: suppress CPython 3.10 interpreter shutdown leaks c445bc285cb test/osd: fix Message and Connection refcount leaks 70328ef12a9 mgr/dashboard: Improve oauth2 sso configuration Add possibility to configure email_domains and scope parameters in oauth2 sso configuration Fixes: https://tracker.ceph.com/issues/75020 2178a1aa771 doc/scripts: use raw string for regex in gen_state_diagram.py a1541865f79 rgw: multisite sync data_log error handling broken in tentacle 7a130a9934b rgw/lc: add coroutine support for cloud-transition and cloud-restore e2d82d67759 ceph-volume: pass --set-keepcaps for FCM crush device class on mkfs 8093f1bff33 ceph-volume: add tests for raw prepare --osd-fsid 272f514df72 ceph-volume: add --osd-fsid support to raw mode prepare 38dff0c10c4 crimson/tools: add dump-superblock command to crimson_objectstore_tool d4249ba53db crimson/tests: fix unitest-seastore-randomblock-manager 97dcba15eb5 crimson/osd: use a unified super-block for devices 992283a7087 rgw/bucket-logging: handle SigV2 presigned URLs b5a1cd41a95 script/ptl-tool: improve help messages during startup 9e8daeb93ca CODEOWNERS: add an smb group for various smb related files 7d2484c45b4 rgw: account presigned POST bytes_received in usage log b0601df2a55 mr/dashboard: remove rgw_servers filter from radosgw-sync-overview grafana dashboard 363a81ca8d0 rgw: read_obj_policy() consults s3:prefix when deciding between 403/404 6cc12f64b96 qa/cephadm: zap raw devices before OSD deployment 38412a464fe Fix unit test d16b846a495 mgr/tox: adding coverage target to the main tox.ini e3ce6fe3127 mgr/dashboard: Nvmeof gateway group should account for labels ea9c2058c80 radosgw-admin: fix output of sync status 9f0896e9472 crimson/os/seastore: introduce stage_visibility_handoff 3848dafb42d doc: fix Sphinx complaints 7a826727ebd test/mds: fix flaky RepeatedQuiesceAwait 56a3de9e3e6 mgr/dashboard: Persist labels and hosts in service form 2cb8fafb73c mgr/dashboard: Fix service form to take into account labels 5aff6743c6f test/cli/radosgw-admin: align help golden with period/zone delete 981dfa4acef ceph-volume: has_bluestore_label checks all bluestore label replica offsets 195e9f7be29 script/redmine-upkeep: resolve comment misformatting 1ec51404a79 doc/rados: fix markup in troubleshooting-mon.rst 08510edf9f2 os/bluestore: Fix collect_alerts 950cd2c746e os/bluestore: extblkdev related health warnings 0e9478d4a22 extblkdev/fcm: Replace errors with health warning d7086d0d6da extblkdev/fcm: Cleanup bc59cd5acc0 extblkdev: Fix preload f4beeb20386 blk/extblkdev: Health warns from ExtBlkDev plugins e952b0c9fd2 blk: Expand collect_alerts to allow specialization 03ddd5b769b cls/test: Make function parameters by reference not by value be803907a81 src/crimson/seastore: improve block size validation assert message 0efa59c305c mgr/dashboard: Difference in "path" value observed when rgw user level export created via dashboard vs cli c02e203aa7a mgr/dashboard: Encryption key not being passed in gateway group form 2cbc270a345 mgr/dashboard: Allow moving to next when Bidirectional mode is chosen fd3fba28795 mgr/dashboard: Fix review page showing auth details when all hosts selected d5a85f30607 crimson/os/seastore: switch co_routine in circular_journal_space a6012c39548 mgr/dashboard: Round off y-axis value of area chart 1c70ef1c6a2 qa: Handle TypeError in test_filelock e4c4561ec54 mgr/dashboard: Add option to set motd via api 8f1c1e45266 client: do not allow zero‑length reads 83c8c38f217 src/test: test zero-length async-fsync read using ceph_ll_nonblocking_readv_writev aa20dcb0f1b src/test: test zero-length async-fsync read using ll_preadv_pwritev e23afba8b03 mgr: fix continous smb MgrDBNotReady 6d6734a07af doc: update governance.rst to change email address 820a57fa325 mgr/dashboard: [snap-visibility]Edit Client config option remains stuck in loading when nfs user is configured 15cc8987e49 mgr/dashboard: mgr/dashboard: Rename namespace block size field and reorder namespace create form fields 03dadafcf4c mgr/cephadm: fixed tests for haproxy peer communication port 04db68a4ed4 mgr/dashboard : Fix RGW restart/stop issue fixes : https://tracker.ceph.com/issues/76158 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 65e2ba9b16a crimson/os/seastore/cache: conconrrent read of EXIST_CLEAN extents can lead to non-stable and io pending extents 29aa7d9e1b1 mgr/dashboard: Validate no added hosts in second step f026b292da5 docs/start: Reflect multi-arch support for SMB service f4252564eab cephadm/images: Update tags for samba and smbmetrics containers f3af3cf34a0 rgw: align period/zone commands in radosgw-admin help 127f8adc867 rgw/logging: use trans_id for standard access log record 76e76f8e6e5 doc/rados/operations/placement-groups: Add pg_autoscaler allocation description Update Placement Groups doc page with description of pg_autoscaler allocation algorithm. Add example calculations showing how the algorithm prefers fairness over greedy utilization a24132f6bf1 mgr/dashboard: Fix osd modal spacings and footer 513686eaf76 mgr/dashboard: remove sync_from entry when sync_from_all is true e0db1494d70 python-common: Validate Ingress spec peer/frontend/monitor ports Fixes: https://tracker.ceph.com/issues/75704 7d9056e7964 mgr/cephadm: Provide option to configure custom haproxy peer communication port in case user wants to run multiple haproxy services in same hosts cf8c1429cd1 Revert "common/version: strip trailing newline from vendor release file" Revert "src/common/version: append vendor release to ceph version(s) output" f4b21d5eb73 os/bluestore: remove obsolete "zoned" freelist type b06b7a82ed1 rgw: Inject keystone userid into IAM policy 1e6e3934666 rgw: Inject keystone roles into IAM policy 66e7c8347aa mgr/cephadm: Add RDMA device check only when ip is available in 'cephadm list-network' 6696b107daa mgr/nfs: Added nfs cluster level RDMA precheck for enabling RDMA for export If NFS cluster level RDMA is enabled then only allow transport as RDMA at export level 0e2b9d3a6e3 ceph-volume: skip /dev/ram* devices in inventory 5155b2125db mgr/dashboard: mgr/dashboard: Carbonize Realm Name and Token block in Multi-site Replication Wizard a13f3e0858f mgr/dashboard: Option to select archive option while Import Multi-site Token f17f4064af1 mgt/dashboard: Add the CPU, Memory to CephFS dashboard 406607c06a6 cephadm: Expose RDMA device inside NFS container if RDMA is enabled Fixes: https://tracker.ceph.com/issues/75189 9d82e2f2d9e mgr/cephadm: Add precheck for RDMA devices when deploying NFS with RDMA enabled fb932fb4269 cephadm: Added command to list RDMA devices Added 'cephadm list-rdma' command to list RDMA devices and their netdev interfaces f7129991519 mgr/cephadm: NFS Configuration for RDMA support 8699699c509 mgr/cephadm: Allow colocation for NFS daemon to support active-active mode, Spec will have colocation_ports field to accept ports for colocating daemons b8143652d73 crimson/os/seastore/cache: Seperate commit_replace_extent paths a9c0419613d crimson/os/seastore/transaction: rename need_wait_rewrite b6e66303ba4 crimson/os/seastore/cached_extent: Generalize io_wait_t a40a450af71 mgr/dashboard: remove archive option from master zone creation 14d958ae2da mgr/dashboard : fix-non-versioning-bucket-issue fixes : https://tracker.ceph.com/issues/76109 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 0bb89e40195 mgr/cephadm: fix typo in schedule.py comment (specified) f2d8ef5cbfe mgr: Modify unit tests to reflect changes Modify calc_final_pg_target test cases to reflect optimization algorithm Add test cases that ensure cost is respected to ensure pools get rounded closely to target 1933993bcb1 mgr: Fix autoscaler not distributing PGs evenly + wrong pg_left update Add optimization algorithm to distribute PGs among pools to minimize cost (absolute difference between target PG and rounded PG). Fix autoscaler still allocating pools when autoscale is off but bulk is on c3e57712272 rgw/gc: mark rgw_gc_max_objs as startup-only 97602ec41e1 qa/rgw: crypt subsuite tests compress-encrypted ffe4fcc7779 qa/rgw: rgw task can enable/disable zone features 863a5f2dcb2 qa/rgw: don't duplicate 'user list' commands for default zone c82cd26ac4c crimson/tests: fix test_remap_pin_concurrent c37c37f6507 qa/suites/rados/thrash-old-clients: ignore "Reduced data availability" warning 04741d381b6 rgw: fix cloud tier multipart resume starting at part number 0 35b4ef415fd rgw/cloud-restore: strip quotes from ETag on cloud tier fetch 76dbdf8aad3 test/rgw/kafka: cleanup kafka tgz file 195cc2f8c23 mgr/dashboard : Select replicated rule by default in pools form fixes : https://tracker.ceph.com/issues/75632 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 5c29aa59589 mgr/dashboard : Fix application names in pools form Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> f07f12152a2 mgr/dashboard: show rados ns in 'ceph nvmeof top io' c422083ab3f mgr/cephadm: preserve in-flight D3N allocations during fresh deploy 977bac22e85 doc/releases: fix Tentacle data in releases.yml e6fb9af2263 mgr/dashboard: introduce traddr together with existing server_address for backward compatibilty 94783c96b06 mgr/nfs: Cephadm support for NFS-Ganesha TLS configuration adding new option xprtsec e777a22a184 mgr/dashboard: tearsheet-layout-fix 92b3bdbf8f3 Fix test_remote_executables 79d72fc70cd mgr/cephadm: Implement D3N L1 persistent datacache support for RGW 1330b2926a9 qa/cephfs: exclude ceph-osd-{classic,crimson} in fs:upgrade:featureful_client:upgraded_client 3df770e1fc1 qa/cephfs: make test_journal_migration immune to stdout changes 6fa8d64ed6e mgr/dashboard : add stretch cluster validation for pools form fixes : https://tracker.ceph.com/issues/75667 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 36c6b9261c2 mgr/dashboard : Unable to remove gateway node from gateway group f609fe76de2 mgr/dashboard: Allow upper case encryption algorithm values in NVMeoF CLI Fixes: https://tracker.ceph.com/issues/76106 dc5fd8710ca dashboard: align notifications footer to bottom when body has fewer items 87751a6dbaa doc/rbd: Add group name to nvmeof-target-configure.rst 3ea2d45239b qa: Fix checksum calculation on empty directories b6713920330 qa: Add mirror test for snapshot with only dir 66827323fcb tools/cephfs_mirror: Fix sync hang 2006412be9f qa: fix setting rbd_sparse_read_threshold_bytes in test_migration_clone() aba0027446f rgw: require RestoreObject Days >= 1 eaa20136862 qa: Valgrind suppression additions to pattern match inline functions stemming from CPython in mgr 9e3aabbc941 test/mgr: clang-format changes to test_ttlcache 3a8683c3e7f test/mgr: Add unit tests to CMake cf99589b9dd rgw/cloud-restore: Correct the restore svc shutdown order a423202c58d mgr/cephadm: fix NFS ganesha service registration via nodeid and register_service 0eb1b13ca48 mgr/cephadm: add nodeid and register_service for NFS Ganesha service visibility a9e099307b7 python-common/hostspec: normalize hostnames for case-insensitive matching 01a5ce89bcc mgr/orchestrator: sort host labels in ceph orch host ls output cd1872b157d mgr/cephadm: increase default backend health check interval for NFS 18ad3107206 mgr/cephadm: Fixed test_scheduling.py Fixes: https://tracker.ceph.com/issues/76079 666bc67e5c3 mgr/cephadm: Added retry logic for execute command if command fails with connection error e1b24eac6d0 mgr/dashboard: sync policy created for a bucket in Object >> Multi-site >> Sync-policy, is not reflecting under bucket's replication 62cddf8e1e8 test/mgr: Add negative unit tests to MgrCap 25c3591105f test/mgr: Add ServiceMap unit tests 1fde5e358e4 test/mgr: Add PyUtil unit tests 535ae6dfd0e test/mgr: Add PyFormatter unit tests fd0e8e89809 test/mgr: Add DaemonState unit tests 0b3c41c52f5 test/mgr: Add DaemonKey unit tests 723e5cfa318 test/mgr: Add ClusterState unit tests 72302bf13e4 test/mgr: Add TestMgr scaffolding to support unit tests 75d62e94424 rgw: fix uninitalized fields in pubsub topic creation b81bc953173 rgw/sns: ListTopics uses account root arn for policy evaluation ccdbebd925b rgw/iam: add helper rgw::account::root_arn() e00a7dfd6fc qa/tasks/cbt: install pdsh from el9 RPMs on el10 systems f2a0e302dc2 test_cephfs.py: delete purge_dir() helper method, use rmtree() instead 99b81c19e09 test_cephfs.py: remove rendundant call to purge_dir() 962a0c5b071 test_cephfs.py: test rmtree on root defbc0651e4 pybind/cephfs: don't attempt to unlink root in rmtree f8d88d51180 test_cephfs.py: test rmtree with and without should_cancel cb6762d12ef pybind/cephfs: make should_cancel option parameter for rmtree() 62f93c47697 mgr/volumes: clone using cptree() from cephfs python bindings 4723efe99c7 test_cephfs: add unit tests for cptree() in cephfs python bindings 1bb899edaca test/pybind/assertions: add helper method assert_less c12e7a56ac3 pybind/cephfs: use depth-first, non-recursive approach for cloning 606ac6d590a test_cephfs: call object setup/teardown for all tests in TestWithRootUser 0d77f4a0234 test_cephfs.py: add tests for utimensat() ff010ad8d1e pybind/cephfs: add python bindings for utimensat() 66150fa2a2d qa/cephfs: add tests for chownat() 50f1291be79 pybind/cephfs: add python bindings for chownat() 954e967636c test_cephfs.py: add tests for chmodat() 4114b697209 pybind/cephfs: add python bindings for chmodat() 4c71cb7d40c test_cephfs.py: add tests for symlinkat() ebfcc6d1903 pybind/cephfs: add python binding for symlinkat() 4dfed1984d0 test_cephfs.py: add test for readlinkat() c41ddf73b55 pybind/cephfs: add python binding for readlinkat() 2b39b48b09a pybind/cephfs: add tests for statxat() d650b5ac9f6 pybind/cephfs: add python bindings for statxat() 6b1bbae7b71 test_cephfs.py: add tests for mkdirat() 6ee0ef33e3f pybind/cephfs: add python binding for mkdirat() 93469d4895c mon/MonClient: check stopping for auth request handling 193541e04c1 script/ceph-backport: skip fetch if merge commit already exists locally 7b72f06c992 rgw/dedup: This PR extends the RGW dedup split-head feature to support objects that already have tail RADOS objects (i.e. objects larger than the head chunk size). Previously, split-head was restricted to objects whose entire data fit in the head (≤4 MiB). It also migrates the split-head manifest representation from the legacy explicit-objs format to the prefix+index rules-based format. aad028500fc librbd: tweak ReadResult's handler for SparseBufferlist type bd2204f7283 librbd: avoid losing sparseness in read_parent() 7b2a9141053 qa: fix misleading "in cluster log" failures during cluster log scan b977ede7776 qa/radosgw_admin: add a testcase to verify use of --marker and --object-version in bucket listing 0564024ac1d qa: Port rgw multifs test to crimson-rados 679f93818aa cmake/isal-l: explicitly configure libdir to avoid wrong libisal.a location. 8ecdabf5f6c CODEOWNERS: add a build-sig group for various build / test files b1bab68b71a mon/MonClient: un-inline MonCommand ctor/dtor to reduce compile times 3e503c8935c mon/MonClient: eliminate duplicate start_mon_command() overload 70882016a73 mon/MonClient: move inner class ContextVerter out of the header 7fdb750acaa mon/OSDMonitor: include cleanup f3f09719de7 Revert "vstart: disable extblkdev plugins for file-backed OSDs" 990c0af5966 extblkdev/fcm: do not abort on multi-device volume before we discovered it's FCM one 542f17513d2 qa/valgrind: generalize and group MismatchedFree suppressions 809839e5f01 Fixes for subvolume overview in grafana - multiple values were shown in graph and single state - Remove All selection from subvolume path 18607c563d9 mgr/dashboard: table cell inline edit emit editing state b868b98fb50 kv/rocksdb: Fix priority of rocksdb cache perf counters 278ace1bc4a crimson/osd: fix race between AllReplicasRecovered and DeferRecovery f3940400952 osd: Allow multiple objects with same version in missing list. a1fc00082c5 cephadm: fix HAProxy/RGW IPv6 failure (ip_nonlocal_bind) 0457ac58b6e mgr/dashboard: NVMeoF namespace create form should show subsystem selection first e61684de67f mgr/dashboard: fix namespace block size in namespace form f0f6b71e884 rgw: remove the now unused RGWAsyncLockSystemObj and RGWAsyncUnlockSystemObj classes. 573dc5f4aba rgw/multisite: use aio_operate for RGWSimpleRadosLockCR/UnlockCR 3a0bf9bb583 rgw: return additional checksum headers too 933e4606c09 qa/rgw: add PutACL backward compatibility test for account migration 6d8dd942d28 rgw/account: Update the docs to add note about supporting backward compatibility for s3:PutAcls calls for users migrated to account. 8ca9c0b1843 rgw/auth: don't mix role ownership between accounts and tenants 55b9bc87d00 rgw/account: Support backward compatibility for s3:PutAcls calls for users migrated to account. 7d936833bd2 qa: update yaml file for TestCorruptedSubvolumes 1fa1b3ed7e1 os/bluestore: print effective extra in 'bluefs stats' report d60ec8e0acc qa: remove vestiges of ceph-deploy 55968723d68 doc: remove references to ceph-deploy aff948588a3 qa: add trivial cephfs-tool bench test e9d49ee7ba5 doc/cephfs: add cephfs-tool documentation a6245eec07d tools/cephfs: add new cephfs-tool e036f3e586e mgr/cephadm: adding daemon_name as argument to nvmeof get bundle API 83cd3c3040a mgr/cephadm: adding new UT to cover the new nvmeof API 7fd7de89e8d mgr/dashbard: adapting the code to new the new cephadm's nvmeof API f2a96c95efa mgr/cephadm: adding new API to get nvmeof TLS bundle from certmgr eb7dc725748 mgr/cephadm: fix nvmeof server/client cert/key fields setting 56123af6477 cephadm: wait for latest osd map after ceph-volume before OSD deploy 6fa0fca6d76 mgr/cephadm: create default pool for nvmeof 815d1d73a71 qa: enforce centos9 for test 9f2cac88d96 qa: rename distro 1e31a6deaf4 qa/suites/fs/bugs: use centos9 for squid upgrade test d8cc2ea40c4 qa: remove unused variables 5b2f5ee9194 qa: use centos9 for fs suites using k-testing 6bf6fcb2b19 qa: update fs suite to rocky10 b81cca65178 qa: skip dashboard install due to dependency noise 6fa39caea77 qa: only setup nat rules during bridge creation 83ecfdfe8b9 qa: correct wording of comment 60b31e50217 qa: use nft instead iptables 5c511835c3c qa: use py3 builtin ipaddress module 93a89d8edfe qa/suites/rados: temporarily disable ceph-post-file test 565077e2f1c rgw: return an etag header for all successful complete-multipart 624adc09431 mgr/dashboard: Add port and secure-listeners to subsystem add NVMeoF CLI command Fixes: https://tracker.ceph.com/issues/75998 7a042b07983 qa: ignore expected MON_DOWN f2b53a0019c doc/rados/configuration: Update bluestore-config-ref.rst WAL+DB sizing 5cf6a04dbbc cls: return EIO instead of ceph::from_error_code() 2e3b6f32450 rgw: Add documentation for the --pretty-format option 8072940c32e mgr/cephadm: fix nvmeof TLS handling and add coverage for ssl/mTLS d9c5358206a ceph.spec.in: replace golang github prometheus with promtool binary path 0ea899acd5d mon: simplify discard queue health warning 7c673bd4162 crimson/os/seastore: remove an extra continuation in delta-overwrite path 6a32153e2d9 *: Update PendingReleaseNotes for librados.hpp CLS breaking API change 4c295ad3a65 rgw: migrate to using non-deprecated class call functions 49423079f16 test: Fix up librados/neorados tests 43cf7eb8585 cls: Remove legacy ACL/Crypto and key_value_store class methods. f28f0660927 cls: refactor class directory and tests to use trait-based API 8a2793fa735 librados: enforce compile-time read/write semantics for class methods 2618b8b1154 mgr/dashboard: Add location to gateway info command in NVMeoF CLI Fixes: https://tracker.ceph.com/issues/75968 05f80acd3dd qa/tasks/admin_socket.py: replace git.ceph.com with GitHub raw URLs 45eb80033f2 mgr/dashboard: validate args in nvmeof top cmds 0b54e22e1fa mgr/dashboard: replace deprecated codecs.open with open f72d721552a ptl-tool: drop deprecated codecs.open ee82dc034a1 qa/suites/rados/encoder: remove rocky from supported distros c08a0eb3254 osd: avoid ceph_abort in build_incremental_map_msg when newest_map is missing 133701fabfc docs: Stretch-EC design doc 0063491fa2d mgr/dashboard: Add namespace encryption support to NVMeoF CLI Fixes: https://tracker.ceph.com/issues/74965 d6649c8e7e8 mgr/dashboard: Making 'ISA' as default plugin for EC profiles created through dashboard Fixes: https://tracker.ceph.com/issues/75312 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 996b145e08b mgr/cephadm: fix nvmeof reconfig loop by preserving daemon deps f73bfab54c1 src/osd: add more logs to the AllReplicasRecovered handler e84f81c421c qa/cephadm: fix NFS ganesha startup failure in containers 66e2d43a7e1 container/build.sh: fix debug tag overwrite 50a1bc6fe8a mgr/dashboard: Add option to edit zone with keys/ argument like"sync_from" and "sync_from_all" f62e811f9ef rgw/posix: fix Inotify member initialization order race 69eff2d74b4 mgr/feedback: make tracker URL configurable and stop hitting live tracker in tests f31b22f2e74 mgr/dashboard: return 400 for all tracker API errors in feedback fba30067e93 rgw: Add new Lua postAuth hook that is being run after authorization f3f8bde10c8 nvmeofgw: propagate quorum feature to the NVMeofMonClient, reverted feature bit NVMEOF_BEACON_DIFF: 9306fdf9ead Revert "mon/MonClient: add get_monmap_required_features() helper" 01802f6ae58 dashboard: align 'no notifications available' icon in notifications page babefb71d3a os/bluestore: Add perf counters to measure frag tracking latencies 7bcbfc3df93 common/options: add option to track runtime and static object fragmentation 67ed1f5e7b9 os/bluestore: Print stats of Runtime and Static Frag Scores using Admin Socket 051833ce94a os/bluestore: Adding Runtime and Static Fragmentation Score to BlueStore 1b6578e07f8 qa/valgrind: generalize suppressions for gcc-14 MismatchedFree db3ba638e9f qa/cephadm: derive container image from cephadm release 38affe97b89 qa: fixing target release for MDS upgrade to be umbrella 301c969bc9d cephadm: stop start cluster 3a0f9ee5099 ceph-crash: reduce log noise from auth fallback in post_crash() 7041f6b6b31 mgr/crash, mgr/status: return negative errno to fix CLI exit code e2df25bd664 qa: fixing nvmeof orch smoke test d98b45a329b libcephfs_proxy: remove unused field in protocol 6e56c705b90 rgw: add Content-Type header to Vault KMS requests cda3527a3d9 libcephfs_proxy: fix passed buffers for fscrypt functions ca99febcefb mgr/dashboard: NVMe-oF Initiator Hostname Pre-validation 957c6b0b0e7 doc/cephfs: Remove spaces from command d605c9a274c crimson/os/seastore: fix WITH_ZNS builds 11e45a45f5e debian: build with system jerasure and gf-complete da7d3b28475 qa/tasks/pykmip: archive pykmip log after server down 995fd245979 qa/tasks/pykmip: use OpenSSL names instead IANA 4698fff408a qa/tasks/pykmip: drop py2 deps fd204679819 Revert "qa/rgw/crypt: disable failing kmip testing" cf903b161c9 rgw: add internal docs for `radosgw-admin object manifest ...` sub-command 4ef668e69b9 mgr/dashboard: use border-subtle utility class in overview and tearsheet 3dae903c9a3 rgw: add accurate Retry-After header to rate-limit responses 6f648e7c8ce qa: fix nvmeof upgrade from v20.2.0 b747e174842 mgr/smb: relax name length validation to support KMIP/GKLM aliases e9abc5ce0bb mgr/DaemonState: forward-declare class DaemonHealthMetric 09960df1e83 mgr/MDSPerfMetricTypes: include cleanup 35f6dd06dd0 mgr/DaemonState: move PerfCounters classes to separate sources d2d4c7d3f86 mgr/DaemonState: forward-declare types from MMgrReport.h aec62d9eb6f mgr/DaemonKey: include cleanup 437e8949ea6 mgr/DaemonHealthMetric: un-inline methods to reduce header dependencies e35375b6732 cmake: add WITH_SYSTEM_JERASURE option for system jerasure and gf-complete ebbb3d75300 cmake/erasure-code: provide vendored jerasure as Jerasure::jerasure target d1d07a05422 debian: remove stale distutils override from py3dist-overrides e62295ab38a mgr/dashboard: Fixing IOPs chart values as whole numbers Fixes: https://tracker.ceph.com/issues/75872 0a73f686c87 python-common: multi-line for yaml 7949cd5f12e libcephsqlite: ensure atexit handlers are registered after openssl 1c7171bb861 squash! test/rgw/multisite: add test_versioned_lifecycle_deletes 3ae00074d90 fixup! rgw: break the coupling of olh epoch and epochs of olh ops, and make the epochs of olh ops ever-increasing c94f8963a79 qa/suites/upgrade: ignore temporary OSD_HOST_DOWN health warning f499e549c01 doc/rgw: describe more details of bucket index shards and resharding 8cb47dbdaac doc/rgw: fix radosgw-admin command names in man page 0a780e21be5 common/perf_counters: improve add() performance 55da168fa07 mgr/DaemonHealthMetric: add missing includes 7bfbdb328a7 mgr/DaemonState: include cleanup 119f9ad1980 mgr/MgrClient: un-inline destructor to reduce compile times 1aef3773f3b mgr: add missing includes bb0f1228209 osd: add missing includes d392564a4b1 qa/suites/crimson-rados/../pggrow: increase op_delay abfacf696b1 ec: validate memallocs in ErasureCodeIsaDefault::prepare() 444b8c92bea src/common: optimize crc32c using zbc extension for riscv64 3c1ee9fe8a9 mgr/dashboard:Adding MSR EC Profile via dashboard Fixes: https://tracker.ceph.com/issues/75547 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 516dfd63ce6 doc/rados: improve operations/erasure-code-lrc.rst f1e51a9551d src/osd: fix typo in asok command help in OSD.cc d19578ffa77 rgw/test: enhanced java s3-tests change setting of JAVA_HOME 29f7c3ab302 doc: add notable changes for v20.2.1 2f18adfcb6e doc: add 20.2.1 Release Notes 859e741322a crimson/osd: use O_CLOEXEC with pipe2() in get_early_config 0ec21732353 mgr/dashboard: fix delete subsystem issue ab9dd102415 doc/man: fix spelling etc errors (1 of 2) bb6d4d7457d ceph-volume: skip mkfs discard for LVM NVMe OSDs 9ccf2ff5173 doc/rados: fix command syntax in add-or-rm-mons.rst 4901f2c08ce qa: suppress reachable dlopen leak in libceph-common c8a9c174b10 mgr/dashboard: Subsystem details page opens at stale scroll position after Add Namespace 8f359724d2b crimson/osd: fix omap key removal encoding mismatch cdc9c70c765 crimson/osd: fix cmp_xattr handling for RGW delete 08d257c043b crimson/osd: fix get_xattrs handling for RGW delete f1065799d49 crimson/osd: allow CLS call after delete in op list 3ea29564dfa qa/crimson-rados: Disable some failing rgw tests b9198a6a202 crimson/osd: allow ops with non-empty hobject key 71d5d72a490 qa: Port rgw sts test to crimson-rados 79c2c64d4e1 qa: Add rgw singleton test to crimson b6300769d74 test/crimson/seastore: add missing crimson::gtest to link libraries 6d9d564d66b crimson/osd: make load_obc(obc, md_ref) return void 12b7a441dbe crimson/seastore: avoid using 'final' to mean 'override' b91a9dfaace crimson/seastore: use correct signature for start() 2d5d75f7596 fixup! test/rgw/multisite: add test_versioned_lifecycle_deletes b438348a65e fixup! rgw: break the coupling of olh epoch and epochs of olh ops, and make the epochs of olh ops ever-increasing c6825a58cc7 test/rgw/multisite: add test_versioned_lifecycle_deletes b4b8c63ace1 rgw: ensure backward compatibility on handling CLS_RGW_OLH_OP_STALE during upgrade 75c7b8ece79 rgw: break the coupling of olh epoch and epochs of olh ops, and make the epochs of olh ops ever-increasing b1c1ddaf0b7 mgr: guard close_section calls in get_perf_schema_python 482fa3041ab crimson/test: rm 'assert's in test_object_data_handlers.cc 907304b3a26 qa/standalone/misc: make less noise for asok calculation b8e2796270f rgw: java s3-tests change setting of JAVA_HOME 14fbad99d2c doc: add RBD_LOCK_MODE_EXCLUSIVE_TRANSIENT release note 7b6e3e78e64 mgr/dashboard: Fix tags in subvolume list and subvolume groups list 3c4079ad7f2 mgr/dashboard: Rename Alert breadcrumb to Alert Rules 36baf60d3e8 doc/man: improve ceph.rst 8d2b1ac686c rgw: CompleteMultipartUpload can fail with 404 NoSuchUpload d945ff851d1 common/util: silent "warning: ‘cgroup_limit’ may be used uninitialized" 8293aa38bd9 mgr/dashboard: run kcli commands in libvritd group cf0a466c226 blk,os/bluestore: do not call extblkdev::detect_device on every KernelDevice::open() 980177003c2 test/crimson/seastore/test_object_data_handler: always initialize the object's known_contents 92e902ecfe2 vstart: disable extblkdev plugins for file-backed OSDs 9dfbc4c9c50 BlueFS: _flush_and_sync_log_jump_D should validate that log.writer->pos <= jump_to to avoid potential log overwrites. d9391f6f428 Change format e60db5a1db6 Support build image with docker 69dc4296d5e qa: add back centos9.stream fb9936c6000 Revert "qa/distros: link random distro to supported" a600cdf9738 qa: remove file from silent conflict b20a3b7c679 qa/multisite: fix test_bucket_remove false failure on bucket deletion check 81bd13981a1 ceph_mon: Fix shutdown order to destroy Monitor before closing mon store 2ca625237e2 doc/rgw: add doc regarding bucket listing with pagination 1b62516014f rgw/admin: enhance bucket list --marker (pagination) to also support versioned buckets e9dbee4f8be mgr/cephadm: add unit test to check smb service get_dependencies call 7649cca5576 mgr/cephadm: add get_dependencies to smb service class e1639e29d3d mgr/cephadm: don't try to map /etc/kmip if it doesn't exist 3bb05bcc5ad mgr/dashboard : Add bottom padding for dashboard screens fixes : https://tracker.ceph.com/issues/74243 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> f144cf27ffb mgr/dashboard : Restrict create storage class with existing name fixes : Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> cf8eafb6851 crimson/osd: remove unnecessary named string for --smp value ada944b7271 crimson/osd: make early_config_t::to_ptr_vector private 23d82f8829f crimson/osd: remove duplicate include of main_config_bootstrap_helpers.h ff8b2601af2 doc/governance: Update governance.rst to change the email id f7e82e9f8a9 rgw: avoid doubled ARN in GetBucketReplication for pre-existing data f745f80ca4d src/crimson/osd/osd.cc: add osd_objectstore field to osd metadata f18093fc09b mgr/DaemonServer: Limit search for OSDs to upgrade within the crush bucket. dc54e2043b1 crimson/os/seastore: make the common write case the fast path 79d5590f986 mgr/dashboard: keep notification tests in the past 0c5b2102042 mgr/dashboard: fix-subsystem-loading-page-issue 10d9a6c70f4 test: Add option to select data generation type 011f9d6c9c3 crimson/osd/pg_recovery: call MOSDPGRecoveryDelete instead of MOSDPGBackfillRemove 37ca0e0f773 osd: fix PrimaryLogPG op ordering during laggy state 893d1be0277 doc/hardware-monitoring: improve index.rst 84ade9a02ce mgr/dashboard: telemetry banner causes UI freeze on initial load 53032041c32 doc/ceph-volume: Fix spelling etc errors e65af75a67b This change introduces the shared memory communication (SMC-D) for the cluster network. SMC-D is faster than ethernet in IBM Z LPARs and/or VMs (zVM or KVM). 6218ce52e9d found duplicate series for the match group {fs_id="-1"} b625cf130e3 client: Use correct size for fscrypt dummy key 5022557a0f2 common/version: strip trailing newline from vendor release file 8ee4ca1c216 qa: Exclude missing ceph-osd-classic and ceph-osd-crimson from tentacle installs. f2ab6d5fcca crimson-rados/cephfs: add cfuse suites from smoke 366702057e6 mgr/dashboard: Add 'network_mask' to nvmeof cli dba51e2ad35 Updates for review 620d6831918 qa/tasks/cephadm.py: only pass --objectstore when not bluestore e61cc528cac crimson/os/seastore/object_data_handler: fiemap return laddr continuous mappings as a single region 5671d8f9d4a test/crimson/seastore/test_object_data_handler: add the UT case for aggregate read ff8bb0bab5d crimson/os/seastore/object_data_handler: read consecutive extents in batches 19804511568 crimson/os/seastore/transaction_manager: add read_pins 936b5f67d30 crimson/os/seastore/cache: add "read_extents_maybe_partial" 3f06a8f0c4d crimson/os/seastore/device: add readv f276ad96948 doc: Fix Sphinx warnings 6e09062fcc4 rgw: Add Bucket tags attribute for Lua scripts 870d53f1d9e mgr/cephadm: support no pool value in spec for nvmeof gateway fd39ac1a23a radosgw-admin: output bucket sync checkpoint to stdout 8b9dbb50d08 qa,src: replace deprecated egrep/fgrep with grep -E/grep -F 1f967b1732e common: remove unused arch.h a519613c404 crimson/osd: fix inaccurate comment about child early-exit in get_early_config f7ffbec8f5c crimson/osd: remove redundant comments a1a66fa5bc4 crimson/osd: fix wrong log arguments in get_option_value and _get_early_config a89074c6bee mgr: replace deprecated PyImport_ImportModuleNoBlock with PyImport_ImportModule aa859508bd8 osd: fix ASAN ODR violations in denc-mod-osd ed4c1a4a9d3 doc/dev: fix typos in running-tests-locally.rst 0db7befa09a src: fix 'recieved' typo across codebase 31842a048ac doc: fix typos and outdated refs across developer guide a448957bc8f doc/dev: fix typo in basic-workflow.rst 7af3e1859ef test: completed TODO's for rbd-snapshot b295b57370d change pointer 0e11ec07199 tidy method d932c880249 mgr/dashboard: fix subvolume group corruption from smb share form 3ccfff1acd6 src/arch: fix hwprobe include path and ZBC/ZVBC offsets for riscv64 844ce555786 src/common/options: Modernize language in global.yaml.in 8a32b79c0d5 mgr/cephadm: Fixes infinite loop when OSD zap fails during removal 27f01a6a68c mgr/rook: Explicitly enable prometheus module fa41ae5caef mgr/rook: Gracefully wait for prometheus metrics. No guessing. 2487e7e746d mgr/rook: fix prometheus federation selector to avoid unencoded '!' 273654c431b rgw: authorization avoids sal::Object::get_instance() f9cf6f6e8b1 rgw/rest: req_state stores original object_key/src_object_key 649ab28a5a0 mgr/rook: copy updated dashboard cli and plugin into rook e2e test image 7674258190f mgr/rook: bump prometheus-operator to v0.90.1 and use server-side apply fc1b98fc47b mgr/mgr_module: add backward-compatible Command shim for CLICommandBase 05966e6f0b4 mgr/mgr_module: add CLICommand, CLIReadCommand, CLIWriteCommand aliases for CLICommandBase fadc4526dcf osd/run_bench(): modify perform_write_test() to adopt Crimson's randomness implementation. 28c3b68086a Crimson/osd/run_bench(): make randomness follow Classic more closely 4443cf6d367 mgr/dashboard: Fix padding of overview page 4887a902853 mgr/dashboard: Fix service name disablemnt in servcie form UI c953b2663a3 mgr/dashboard: fix subsystem creation issue 96104c122f3 crimson/osd: add warning log for stray pgmeta-like objects a6db1b8243c mgr/dashboard: carbonize-osd-flags-modal 595a7537717 rgw/kafka: honor verify-ssl and separate cached connections 6c1d778586e mgr/rook: Workaround PEP 668 restriction when running on Noble 21bf74287c4 mgr/rook: copy all mgr Python modules into rook e2e test image b3b9ea3ccf7 mgr/mgr_module.py: add COMMANDS class attribute to CLICommandBase 2b4a1357564 mgr/rook: handle inactive libvirt default network in recreate_default_network 9af955e8490 mgr/rook: pin DOCKER_API_VERSION to minikube's daemon version b27662763ad mgr/rook: Install ceph-csi-operator CRDs before cluster create 7ddc88d2201 fix(dashboard): align notification icon with timestamp 9b9a23727f2 rbd: improve mirror image status and validation error messages 1f71af4c34c multisite/qa: add test for zonegroup rename 744e9393835 mgr/cephadm: Add KMIP server support for NVMeoF gateway 0ae05bc41af mgr/rook: Use sg to run minikube in bootstrap-rook-cluster 42e53ebea79 rgw/multisite: handle errors from rename in reflect_period() and update_latest_epoch() calls correctly acf8f7c7adf test/rgw/notification: fix rabbitmq dependency for rocky10 e6036bc5338 mgr/cephadm: remove unused manages_own_next_action attribute c3d4bf632a2 mgr/cephadm: remove check for manages_own_next_action 0a76eed0874 mgr/cephadm: move ceph specific action checks to function f2f6698d82d mgr/cephadm: remove special haproxy related if-block 876a366ffa9 mgr/cephadm: add custom choose_next_action to ingress service f9ce0c9ea65 mgr/cephadm: remove special mgmt stack related if-block 318cc0824ea mgr/cephadm: add custom choose_next_action to monitoring services 4d41c00dd2e mgr/cephadm: add custom choose_next_action to ceph exporter service 347543cce2a mgr/cephadm: remove special jaeger if-block in _check_daemons 2a83489b012 mgr/cephadm: add custom choose_next_action to jaeger agent service 2c6775715a5 mgr/cephadm: remove special nfs if-block in _check_daemons 4c68ae74cee mgr/cephadm: add custom choose_next_action to nfs service 3a46e9afb29 mgr/cephadm: use new choose_next_action when so configured b0ce6a5a730 mgr/cephadm: move custom container args 14bc46490d5 mgr/cephadm: add new choose_next_action method to CephadmService 989dc2229e7 mgr/cephadm: add a new Action enum class c8a1451f1db mgr/cephadm: avoid redundant call to cache.get_scheduled_daemon_action e0d441a36c0 mgr/cephadm: remove unused _calc_daemon_deps 863cd25c204 mgr/cephadm: replace _calc_daemon_deps in serve.py dc90caa8f27 mgr/cephadm: replace _calc_daemon_deps call in agent.py e54415149fe mgr/cephadm: add sorted_dependencies function 038cf749a27 mgr/cephadm: update formatting of get_dependencies arguments 5d4ba358dc7 mgr/cephadm: add test coverage for action chosen in _check_daemons 03f137e7c1b mgr/cephadm: add test coverage for action chosen in _check_daemons 390f97e0769 mgr/cephadm: add test coverage for action chosen in _check_daemons 22ac40053c5 mgr/cephadm: add test coverage for action chosen in _check_daemons f5d544d8964 mailmap: Add Karthik U S f87c6bade86 doc/dev/release-checklist: check v21.0.0 tag b2d5654424f rgw/radosgw-admin: minor typo fixes 74880568bc7 cls/{rgw,rgw_gc,otp}: Make use of VLAs an error c3a287146b2 cls/rgw: Replace VLAs/`snprintf` with `fmt::format` 5462945cbf7 cls/otp: Replace VLA with `boost::container::small_vector` 2ac4d3d2fa5 rgw: Make use of VLAs an error f3307bf7b70 rgw/test: Construct argv in vector, not VLA 66acefb095b test/rgw: Trivially remove VLA from checksum test f722480d0d4 rgw: `buf_to_hex` no longer uses VLAs b1fa16c53d8 rgw: Eliminate VLA in `{upper,lower}case_underscore_http_attr` 8777112678d rgw: `RGWHTTPStreamRWRequest::complete_request` no longer uses VLAs 39c803d3afe rgw: Trivially remove vla from `RGWFormatter_Plain::write_raw_data` 83d278d2907 rgw: Rest client header parsing does not use VLAs 9f14fe663bb rgw: Remove VLA from `parse_mime_map_line` bda6c078135 rgw/cors: Remove VLA from `lowercase_http_attr` 80a41b3a683 rgw/dedup: Replace VLAs with `std::vector` 2c693bf4f4d rgw/ssd: Use `boost::small_vector` in place of VLAs ee0983bd2b9 rgw/common: Get rid of VLAs in rgw_(un)escape_str c0c300eaeb2 rgw/common: Remove VLA from `append_rand_alpha` 00604c81045 rgw: Remove unused includes from `rgw_common.{cc,h}`. fbf49d0fbb9 rgw/asio_client: Don't use VLAs when parsing environment 0410e634427 rgw: Use libfmt rather than snprintf when constructing identifiers 7b064a0490e rgw/dbstore: Trivially remove VLA from dbstore main 966f5c65292 rgw: Add `{lower,upper,camel}case_dash_transform` afe3d77d562 build: `unittest_rgw_sync_trace` links to rgw libraries 8c530feb21b rgw/multisite: call update_latest_epoch() only once, outside the create_period() function. calling it twice for the same epoch in RGWOp_Period_Post, resulted in a -EEXIST response to the second call. as a result reflect_period() which updates the local objects and period history update was being skipped. df096fa3e65 rgw/multisite: remove old zonegroup name from the pool on secondary zone after a rename 14fc52e0974 qa/workunits: Add updated kernel archive URL 9bccd831d8b rgw: always decompress in CopyObject when source is compressed 3ce085076a1 librbd: use try_lexical_convert instead of throwing lexical_cast 6f0d9e27953 mgr/smb: add unit tests for InvalidObjectTypeFieldError handling 48e6fc2c4e3 mgr/smb: add specific exception for wrong types when dict/list expected c36fea47579 rgw/iam: User/Group/Role apis map ECANCELED to ERR_CONCURRENT_MODIFICATION b157db9cabc extblkdev/fcm: Add plugin identification for fcm dfb43c0d4e9 extblkdev/fcm: Do not enable set_keepcaps by default 1054d63e52c extblkdev/fcm: Change douts/derrs 52424420db5 extblkdev/fcm: Create perf counters with fcm stats 2a0e3418d8d fixup warning of fcm plugin core 9c0c40cfa69 extblkdev/fcm: derr when FCM and no block device discard 4f85256062a extblkdev/fcm: Refuse to operate on multimedia lvm block devices b703ac41180 extblkdev/fcm: Adapt FCM plugin to RHCS9 b0174c013dc added FCM plugin 957b4b61904 test/rgw/notification: fix the cloudevents package version b75faf7d43b osd/scrub: avoid repeated config::get_val() call fd60474cfbd osd/scrub: extract stats update code from scrub_finish() fb66feae246 osd/crub: remove redundant code ae7977594f5 docs: reorder mon and mds for future new releases 412e0ab7bb1 doc: Check redmine-upkeep.yml to add umbrella. ed94870001c script/ceph-release-notes: add umbrella b26f4dd05af osd: Remove unused osd_perf_counter "scrbcnt_write_blocked" 1c23b001e18 qa: qa tasks from the release checklist for Umbrella db036a7b33d include: Remove incorrect "available" comment for feature bit. (cleanup) 9116a3c780c qa: add X-1 release (tentacle) to fs upgrade suite 8499d6bd5bc qa: remove reef code from fs 630eee34a0c osd: Remove octopus-depending code in Fast EC a96af3795f6 osd: Update remove after squid to remove after umbrella comment 4f4d21712b4 qa Upgrade to Umbrella 2cf246642c5 doc: Confirm DEPRECATED checklist item and clean up pg_scrubber 766be373026 qa: update require-osd-release to umbrella d58b5c4be10 tools/monmaptool: bump new cluster version to X 7b087cbfd36 osd/OSDMap: update to umbrella fde867de6f7 qa/workunits/cephtool/test: update to umbrella 1d1e8ced705 mon/OSDMonitor: update to umbrella 3f56e99f924 common/options/global.yaml.in: update for umbrella 043df2254dc mon/MgrMonitor: update for umbrella c8f6959227c qa/standalone/mon/misc: update for umbrella 02bf2eec2db doc: update compatset for umbrella 7d34eaed8b6 include/ceph_features: add SERVER_UMBRELLA feature bit e1cc610134c cephadm,ceph-volume: update to umbrella 0e44541ee57 doc/dev/release-checklist: add backport-create-issue bb7a6006b4d *: add constants and release names 8a959d4e3bc ceph_release: update to umbrella 4c9174845a5 librbd: bump version 934b0470c8a CMakeLists.txt: update VERSION 2879a212c5e doc: reset for umbrella 73b1d1e7087 qa/rgw/upgrade: symlinks are explicit about distro versions 060f0447ae9 qa/rgw: remove ragweed from verify subsuite a7c974f549b io_exerciser: Use shared pointer to IoSequence object to avoid updating the Sequence and step for every iteration 3706288bc05 ceph-volume: skip virtual cdrom devices in inventory -Some hosts expose IPMI/BMC virtual media as /dev/sr0. These devices are reported as SCSI type 5 (CD/DVD) via sysfs and appear in inventory/orchestrator output. beaa1202f1d mgr/dashboard: fix the missing injectors for child formgroup tpl 42020a56a74 test: Removed ObjectModel seed generation from constructor 1f435e8c6e2 test: Replace std::uniform_int_distribution with manual code 862d1de7284 test: Change random number generator to be complr independent ff040c1b5f9 io_exerciser: Fix bugs from previous commit 394aaff8ffb mgr/test_orchestrator: fixing daemon_action method signature 24c6e918bac io_exerciser: Improve DataGeneration validation failure error message 3d6f0fe0f81 RGW: add support global CORS rule a9c929055f8 rgw/beast: add frontend option 'tls_groups' ea932a76fb1 mgr/dashboard: [Dashboard] Not able to open "About" window bfa57c57c8b mgr/smb: update fs.py to request all caps for the cephfs volume 7a9483b59a7 cephadm: add pid file directory option to cfg watch sidecar e9594fd65d8 cephadm: add pidfile option to smb keybridge sidecar 7c0acc283c8 mgr/smb: fix unit test assertion 6eda67473ad doc: add documentation for keybridge and fscrypt options d9679dbdb9f mgr/smb: add some keybridge related unit test cases 645877331c1 mgr/smb: add support for generating keybridge configuration 641528992ec mgr/smb: add cross-check validation for keybridge scopes 3407a6df82e mgr/smb: add new cephfs parameter for getting fscrypt keys d0fa08154cd mgr/smb: add keybridge configuration to cluster resource 6980d1ca1eb mgr/smb: add enums that will be used for configuring keybridge 5acad4d6be3 mgr/smb: add raw data methods to MemConfigStore 8a8ee5a06d0 mgr/smb: fix a resource error unpacking str instead of list 837916847f5 cephadm: add keybridge sidecar to smb daemon module fb4ded8271c mgr/cephadm: enable setting up SSL/TLS files for keybridge sidecar 9e091d93910 python-common/deployment: add keybridge feature to smb service spec 4dcc7317837 ceph-volume: fix vendor detection for nvme devices 69442435006 test: Throw error when using ec optimisations with an unsupported plugin e00e327d5fa qa/distros: link random distro to supported b6946369de2 qa/distros: add .qa links 3da3ef70c04 qa: remove special chars from supported-random-distro 67ede202de6 qa: remove redundant single-container-host b1e9845c5b8 qa/distros/container-hosts: remove centos8 160d8d737ce qa: remove distros/podman 0495caa8e6d qa: switch from distros/podman to supported-container-hosts 03bdfd41843 mon: fix source file permissions 7f89c836e96 mgr/dashboard: use osd metrics in performance charts and remove storage type filter a051a2e92ce rgw/placement: display storage class in user info dump 1f923065456 orch/cephadm: fix osd.default creation c0106c5d760 os/bluestore: Add perf Counter to Count Slow Ops in BlueStore 4125ad1c651 os/bluestore: separate slow scrub ops from normal slow ops 9d7b176f43a common/options: use bluestore_log_scrub_op_age for scrub ops f38ef0e652c os/bluestore: Make extblkdev missing a warning 358047f3cc3 extblkdev: Make preload one-time function addb8388637 os/bluestore: Add config bluestore_use_ebd f4a002a0649 extblkdev: Expand interface, add plugin id retrieval dfe79180a71 ceph-exporter: fix systemd unit faf1a3baa4f mgr/dashboard: Allow creating nvmeof gateway group via new flow dafa173733c os/bluestore/bluefs: Make sure write buffer is aligned 47422b39aef test/bluefs: add cases for wal v2 envelope header mislocation. 4c03bbea443 os/bluestore/bluefs: Add assert if write buffer is not page aligned a6d1cba2745 rgw/sts: correct error code to 400 (from 403) for expires sts credentials. f58155732bf qa/multisite: test for 'bucket sync run' 899f2538ffa mgr/dashboard: bump nvmeof submodule to 1.7.2 0378ee8febd rgw: fix fixup_range cascade for compressed+encrypted objects d09c115a31b test/osd: Add extensive new PGBackend test harness. b6e341b17f7 qa/distros/crimson-supported-all-distro: reinstate centos d9a6755599d Revert "crimson/osd, test: turn the EC tests on for crimson" c182e7a1909 crimson/osd: fixes after crimson::os::with_store<>() 94ceb937038 crimson/osd: Avoid pwlc spanning intervals bc0f47174e2 crimson/osd: improve !is_omap() logging 447f33224c2 crimon/osd: drop present_shards from PGLog handler's partial_write() 227099a642a crimson/osd: improve debugs in ECTransaction::Generate::Generate() 4924533853e crimon/osd: implement PG::PGLogEntryHandler::partial_write() for FastEC 2ecc59918ea crimson/osd: port changes from classial FastEC c84e663ca34 tests: LibRadosIoEC allows for overwrites / unalligned writes on crimson c63c64c6afe crimson/osd: implement handling of RADOS' extended attirbutes in FastEC 84cd9dd23b5 crimson/osd: drop unused variable from PGBackend::getxattr() 82794a85ea8 crimson/osd: drop unneccessary variant of PGBackend::getxattr() acf9004539f crimson/osd: don't decode EC only attrs are needed 7f3f1156a8a rmw_pipeline in RMWPipeline::Op 5e4c8bcd64e fixup: crimson/osd: settle ECRecoveryBackend -- local MOSDPGPush 4d4878caab1 fixup: crimson/osd: settle RMWPipeline and RMWPipeline within ECBackend 414728f5b72 fixup: crimson/osd: wire MOSDECSubOpWriteReply up with ECBackend 131f0795fe9 fixup: crimson/osd: route EC messages over PG cc5e5054c03 crimson/osd: fix unused variable warnings pg.cc and seastore d198916ab7d ECCommon: fixups for crimson's FastEC support ab789cad445 fixup: crimson/osd: bring ECRecoveryBackend, phase 0.1 fbed00a3f18 fixup: crimson/osd: translate for os::Transaction into ECTransaction 44e25344f8d fixup: crimson/osd: switch return type of PG::get_dpp to unify with ECListener a7cfb75b68b crimson/osd: switch return type of PG::get_dpp to unify with ECListener 24c29ee70ce crimson/osd: settle ECExtentCache within ShardService 5cd0a4ce3d7 crimson/osd: PGBackend::_read() takes object_size for the sake of FastEC 723374395f8 fixup: fixup: crimson/osd: add support for MOSDECSubOpRead 6e8109f33db fixup: crimson/osd: wire MOSDECSubOpWriteReply up with ECBackend 9c8278bf05d fixup: crimson/osd: implement ECBackend::handle_rep_read_reply() c4fa7c654ce fixup: crimson/osd: translate for os::Transaction into ECTransaction a5bf80da1d7 fixup: crimson/osd: implement ECBackend::objects_read_and_reconstruc d2e3d4738af fixup: crimson/osd: settle RMWPipeline and RMWPipeline within ECBacken b2fd100ff91 fixup: crimson/osd: settle RMWPipeline and RMWPipeline within ECBackend 53581def7b1 crimson/osd: settle RMWPipeline and RMWPipeline within ECBackend 88737b1c85f crimson/osd: tackle the get_write_plan() problem of ECBackend f3738abdb31 fixup: crimson/osd: settle ECRecoveryBackend -- misc small bits of ECListener a3f0f5ed2f1 fixup: crimson/osd: bring ECRecoveryBackend, phase 0.1 44c96e41756 crimson/osd, test: turn the EC tests on for crimson 4c1f93ce825 Revert "crimson/.../object_context: drop recovery_read_marker" e6eca7fc05f osd: ECCommon respects crimson non-null obc for new objects 21a8613965f crimson/osd: bring get_temp_recovery_object() to PGRecovery for EC f919b4eae04 crimson/osd: settle ECRecoveryBackend -- misc small bits of ECListener c9e1a93bee2 crimson/osd: settle ECRecoveryBackend -- local MOSDPGPush 8c35b2811cd crimson/osd: settle ECRecoveryBackend -- bring maybe_load_obc() a7e75bf8071 crimson/osd: make objctx loading agnostic about source of attrs 33b7b7bca04 crimson/errorator: helpers for tl::expected 83a9a013a68 crimson/*: rename errorator-loop.h into errorator-utils.h 9ce78ae56b5 crimson/osd: delegate md loading outside of ObjectContextLoader::load_obc() c65c06d2457 crimson/osd: dissect metadata decoding from PGBackend::load_metadata() 41d95f5ec43 crimson/osd: make OSD::osd_stat compliant with multi-core b3405da33b0 crimson/osd: add support for reads over EC pool a80265ddd58 crimson/osd: fix compiler warnings on copy elision being prevented 1396ddbc359 crimson/osd: on the cloning path bump obj version closer to its usage 9b352d68f51 crimson/osd: fix std::moving in ShardServices e995493bfdc crimson/osd: implement ECRecoveryBackend::commit_txn_send_replies() 23b37c0c4df crimson/osd: implement ECRecoveryBackend::recover_object() 324a7abe2bc crimson/osd: wire up MOSDPGPush and MOSDPGPushReply in ECRecoveryBackend 98c45a1813c crimson/osd: ECReplicatedBackend embraces ECCommon::RecoveryBackend 65ccae1fb81 crimson/osd: settle ECCommon::RecoveryBackend within crimson-osd 0212c49d3ab fixup: crimson/osd: compile and link with ECTransaction.cc d8f003eff8d fixup: crimson/osd: add support for error handling around MOSDECSubOpRead 639357e293e Revert "crimson: clarify RecoveryBackend::handle_backfill_op" 6a29d3ef6cb crimson/osd: wire MOSDPGPush{,Reply} with ECRecoveryBackend, phase 2 34ab35b75f9 crimson/osd: wire MOSDPGPush{,Reply} with ECRecoveryBackend 21c3eaf6934 crimson/osd: bring factory to RecoveryBackend 4b17204d45d crimson/osd: bring ECRecoveryBackend, phase 0.1 8f9a80669aa crimson/osd: conceptually move delete handling out of ReplicatedRecoveryBackend 637b3195582 crimson/osd: bring ECRecoveryBackend, phase 0 5845d126846 crimson/osd: drop the green thread for ECBackend::submit_transaction() 2e97cec6706 crimson/osd: ECBackend::handle_sub_write() handles the end of local write 46b32c2205b crimson/osd: improve debugs in ECBackend::handle_rep_write_reply 34703a9f714 crimson/osd: handle_rep_write_reply() takes ECSubWriteReply c194f7efb5f crimson/osd: extend PG::should_send_op() and move it to .cc 41bf6f52afe crimson/osd: implement ECBackend::objects_read_and_reconstruct d1e23d6ddcd crimson/osd: implement submit_transaction() of ECBackend 1ddbe779591 crimson/osd: PCBackend::_submit_transaction() takes ObjectContext 2d382825815 crimson/osd: bring attr cache to ObjectContext b7c76022721 crimson/osd: compile and link with ECTransaction.cc b811e8a6a5b crimson/osd: drop the mock of ECTransaction-for-crimson from ECCommon bdc4aecf1f0 crimson/osd: translate for os::Transaction into ECTransaction b0c053e67a0 crimson/osd: make ECCommon compatible with libfmt 7ce087a02f1 crimson/osd: wire MOSDECSubOpWriteReply up with ECBackend 48919603029 crimson/osd: implement ECBackend::handle_rep_read_reply() c6666ef00b3 crimson/osd: settle RMWPipeline and RMWPipeline within ECBackend 89f2b28fab3 crimson/osd: add support for ECWrites on replica 94d2719a767 crimson/osd: PG::log_operation() is now able to update hset cef595fc699 fixup: crimson/osd: add support for MOSDECSubOpRead fbcfec382e3 crimson/osd: instantiate an EC plugin a0718b448b9 crimson/osd: route EC messages over PG a1dbf117722 crimson/osd: PGBackend stores pg_shard_t instead of just shard_id_t 3fa67cebdf0 crimson/osd: add support for attr retrieval of MOSDECSubOpRead 4366bfc6cb1 crimson/osd: add support for error handling around MOSDECSubOpRead 32ab54a9ab7 crimson/osd: add support for MOSDECSubOpRead ee5226f0419 crimson/osd: wire the EC-specific messages up 3132bac47f4 crimson/osd: bring ECRepRequest 82e10b113c7 crimson/osd: always dencode object_info_t with hobject_t 32c18e0d7b9 crimson/osd, osd: build and link ECCommon e4a46ae2019 test/osd: Rearrange ECBackend and ECUtil tests f5debfe6b24 Refactor: Extract mock classes from TestPeeringState into separate header files 110a0160e5d Make store_test_fixture create a random dir. dede8807703 orchestrator/test/test_orchestrator: fix return code to negative e2826197531 mgr/mgr_module: fix tox test missing a type annotation 646d49a08fb osd: Twiddle should create a full sized vector for optimized EC 3fc84af76ec rgw/d4n: adding a unique version to every "null" delete marker, but letting the instance be null. 948fb4bb03c rgw/d4n: erasing dirty object entry for delete markers otherwise the cleaning thread keeps spinning on that entry. c25b452414a src: fixing assert_valid_host 5e0eaf56285 container/build.sh: FROM_IMAGE=rockylinux-10 default for >=tentacle 2755bec58f6 qa/distros: add centos 9 stream back to supported distros 3bfe66a2362 mgr/selftest: mypy error fix missing a type annotation f3c938f5032 qa/cephadm: zap raw devices before OSD deployment 4766f3b331e doc/cephfs: Fix spelling etc errors 3dfdf939a83 doc/monitoring: Improve index.rst 2ccda9ae5ba doc: fix release date of v18.2.8 7806ba5cdf3 qa: Leak_StillReachable RocksDB error_handler 7027dc7ef0a rgwfile: common-prefix cp_ref unittest ef93632ae44 librbd/migration/QCOWFormat: avoid use-after-free in execute_request() 0e96c625f69 ceph-volume: fix inventory without /dev/vg/lv (slashed paths) e3b084aaf48 qa/distros: re-install nvme-cli package in rocky tests 25411d57c69 qa: allowlist bpf podman denials on Rocky 10 0cef3dfa2aa qa/distros: bump rocky to 10.1 7a3d1a50d3f qa/distros: add rocky_10 as supported container host 8d864de4d89 qa/distros: bump rpm_latest.yaml to rocky_10.yaml d4b977afdc5 qa/distros: rename centos_latest.yaml to rpm_latest.yaml 1e02818d400 qa/distros: add rocky_9 and rocky_10 dd0b3808b74 add tree branch logic in ceph osd df 81d43e512fe add sort logic in osd perf command 9337cb79de9 mgr/dashboard: Title says "Gateways" but it displays gateway group names in NVME/TCP 1c1443e2bd2 Revert "mds: Hardlink referent inode plumbing work" e45144cf57f Revert "mds: Store remote inode number in referent inode" e9b20cd1fce Revert "mds: Store list of hardlinks on the inode of primary link" 68095820da9 Revert "mds: Commit referent inode to disk" 475b03931c9 Revert "mds: Load referent inode from disk" d452ab798f8 Revert "mds: Make referent inodes a optional feature" a87f6ae4caf Revert "mds/journal: Journal referent remote dentry" bc929543c27 Revert "mds/journal: Replay referent remote dentry" 5c3a69f7b0f Revert "mds: Log and dump referent remote cdentry" b764eafa830 Revert "mds: Log referent_inodes list with CInode" 9e83e1c92de Revert "mds: Handle referent remote similar to remote" 10917fced94 Revert "mds: Handle referent inode while trimming the dentry" 84b97159d07 Revert "mds/migration: Handle referent inode during subtree migration" 9bb13a0370f Revert "mds/rejoin: Handle referent inode on MDSCache rejoin" 7105db78b08 Revert "mds/rejoin: Don't fetch the dir is already complete during rejoin" 9d90040ba8e Revert "mds/mdcache: Handle referent inode on discover" 21669c3d93d Revert "mds/link: Create referent inode and store backtrace" 2ed8ed1a3ee Revert "mds/link: Reverse link primary inode to hardlink" 8fa4e7acbfb Revert "mds/readdir: Handle referent inode" d971d2de540 Revert "multi-mds/link: Create referent inode and store backtrace" da8d93eb609 Revert "multi-mds/link: Send referent inode to dentry_replicas" 07cb558601a Revert "multi-mds/link: Reverse link primary inode to hardlink" 03ebed4c0c1 Revert "multi-mds/link: Handle rollback for referent_inodes list" be13db987c7 Revert "multimds: Consistent view of referent inode list" bccebd22979 Revert "mds/unlink: Remove referent inode on unlink" de7d5a200f6 Revert "mds/unlink: Referent inode - reverse link management" dcfea800df6 Revert "multi-mds/unlink: Remove referent inode on unlink" 1b18af00643 Revert "multi-mds/unlink: Unlink referent inode on dentry replicas" 946b55c17ac Revert "multi-mds/unlink: Referent inode - reverse link mgmt" d5b6af8c6c2 Revert "multi-mds/unlink: Handle rollback of referent_inodes list" ee7d0d09cae Revert "mds/rename: Handle referent remote linkmerge case" 6865e29f6d3 Revert "mds/rename: Handle existing destdn referent remote" f06515b9d48 Revert "mds/rename: Handle source dentry being referent remote" bbc71aad3c7 Revert "mds/rename: Handle referent inode rollback" e920967a57a Revert "mds: Fix straydn race between unlink/rename linkmerge" a5b63cdbacc Revert "mds: Referent hardlink Recovery - Store remote_inode" 5d7ea940448 Revert "tools/cephfs-data-scan: Recover referent hardlink - build dentry" 74a708dbab5 Revert "tools/cephfs-data-scan: Recover referent_inode list" 30d41e7b8dd Revert "qa/test_backtrace: Validate remote_inode xattr is stored" 3c70540726f Revert "qa/cephfs-data-scan: Validate referent hardlink recovery" 38370bfce88 Revert "tools/cephfs-journal-tool: Recover referent hardlink dentry" cd792bf2b06 Revert "qa: Fix dashboard test_health failure" 1ffe937a131 Revert "tools/ceph-dencoder: Add an option stray_okay" b1088ddd617 Revert "qa: Add function to fetch inode from metadata pool" d5523447fcc Revert "qa: referent inode test - link w/ max_mds=1" 2fcd27a9800 Revert "qa: Disable referent inodes for a few test_strays tests" a97958eb0ba Revert "qa: referent inodes - unlink, stray_reintegration" bcba417d0a9 Revert "qa: add more referent inode tests" 6a52636bd61 Revert "mds: Fix mdcache rejoin invented referent inode" 17e56c30313 Revert "mds: Fix MMDSCacheRejoin::dn_strong version check failure" 5cbbd428591 Bump NFS Version in Ceph cc7d0577295 container/make-manifest-list.py: handle "no tags for this version" f5a92b13f3c container/make-manifest-list.py: add version support 8538b776cfd rgw/posix: MPSerializer sets and clears locked status 262175b107a src/ceph-volume: fast device unavailable as error fe883f91df9 rgw/dbstore: MPSerializer sets and clears locked status 740de933664 qa/workunits/mgr: account for nvmeof module being "always-on" 8116eaa57ba qa/workunits/rbd: drop racy assert in test_tasks_recovery() f6e56737408 doc: add notable/security changes in v18.2.8 e682ed1613b doc: add known issues for v18.2.8 30a38149e6b doc: add reef release notes adb50a43658 script: fix argument change for github module cecce28f16b src: Move the decision to build the ISA plugin to the top level make file b9b0529fe26 rgw_file: always assign string_view of current common_prefix 9a1667f973b mds: fix data race on subvolume_metrics_map in MetricsHandler 9c91d30a230 msg/async/crypto_onwire: include cleanup 5826e3e94cd msg/async/frames_v2: include cleanup bf6ad4fe1a1 msg/Message: do not include Connection.h in Crimson mode c688baa007c msg/compressor_registry: include cleanup d2da040115a msg/msg_types: un-inline methods to reduce header dependencies 80c176610da include/Context: add missing include d6b23ad2458 java/native/libcephfs_jni: add missing include 3689aefbba6 qa: test case for evicting clients with id having multiple number of consecutive zeroes 84b0a0dcb9a mds: add a proper check to evict clients with id 0 50c25d95141 mgr/dashboard: [storage-class]: Deleting local storage class from UI does not remove its entry from zone c275cab46e4 mds: Remove unnecessary std::move on trivially-copyable type LockOp in add_lock method e77c06e4c05 qa/cephfs: treat "implicit declaration of function" for blogbench workunit for newer gcc version 60537bdd2f4 crimson/osd/pg_recovery: call on_global_recover on the "recover deleted" object when it's not missing on the primary too f8bc7f6bf79 mgr/dashboard: add helper text to bucket form > policy and other spacing fixes 703a461377b doc: show runtime-updatable config metadata b22d9ee2301 rgw: config options for mp lock error/delay injection ab33073f8a2 rgw/rados: MPRadosSerializer spawns lock renewal coroutine a3a23a522a8 common/async: async_cond Executor defaults to any_io_executor ea634e9d19d rgw/sal: Object::get_serializer() takes optional_yield a1f1811f505 rgw: stop crashing when an admin tries to assume a nonexistent role 3465ae7e910 mgr/dashboard: Add capacity thresholds 259d9e88474 rgw/sal: Serializer::try_lock() takes ceph::timespan 540b8e0ed6d rgw/sal: StoreMPSerializer uses atomic bool locked 143fb6942dd rgw: check for broken lock before multipart complete f6acaa36983 doc: Improve docs in start 8f413300b29 mgr/dashboard: services page breaking for test_orchestrator module 00e2ce86079 python-common: fix raw OSD prepare to use osd-id instead of osd-ids 2ca14b2551b crimson/os/seastore: handle duplicate keys in LogNode::remove_entry c1e473d4c78 crimson/os/seastore: reload head if modified 5dbd9ae5174 crimson/os/seastore, osd/PGLog: handle omap_iterate retry to avoid duplicate entries e55f0c79b10 crimson/os/seastore: ensure data integrity with deep copy in omap_get_value 8f95695ee2e crimson/os/seastore: ensure extent is loaded if missing from cache 484760c5ba0 crimson/os/seastore: correct UPPER_BOUND behavior to start looking up items exceeding the target e5e8d841dd0 crimson/os/seastore: fix crash by checking for nullopt in search input ea24fb9c1be crimson/os/seastore: return correct result for non-logkey entries 3ffb915630b crimson/os/seastore: use do_with to avoid stack-use-after-return ade5e1a8e6a osd/PGLog: set dirty_to to max to avoid partial writes cb81d91d605 crimson/os/seastore: add test for log_manager 51063a5da18 crimson/os/seastore: support for large kv pair in LogNode 4951f64ed06 crimson/os/seastore: optimize handling of batched requests 70a3941ef82 crimson/os/seastore: introduce omap_rm_keys interface in omap_manager 890b5bd3f64 crimson/os/seastore: adjust select_log_omap_root to return a single root 5a63620a8b5 crimson/os/seastore: invoke managers depending types based if branch 1e5e0efe71f crimson/os/seastore: remove duplicate keys for non-log entries 825c8f149cb crimson/os/seastore: make _fastinfo overwritable to minimize space overhead a059868fa93 crimson/os/seastore: add log_manager to handle pgmeta_oid's key-value pairs separately 65b0170b9c9 crimson/os/seastore: remove log_root to maintain a single root for OMAP and LOG 91de6a0b7b8 qa/tasks/backfill_toofull.py: Fix assert failures with & without compression a1c2b561376 mgr/dashboard: Fix loading states in storage overview card 90c09d86798 mgr/dashboard: Add tootltip to storage overview 01dc12ad565 common,arch,cmake: add RISC-V crc32c support 6519c96af76 qa/workunits: add crimson/ and move test_crimson_dump_metrics.sh. Edit osd-dump-metrics.yaml accordingly d42c9cf1e52 mgr/dashboard: Add "connection get_io_statistics" to NVMeoF CLI 3abe170a907 doc/rados: Fix spelling errors (2 of 3) 2f1f1ef0b85 doc/rados: Fix spelling errors (1 of 3) e68e302a738 mgr/cephadm: fix mgmt-gateway startup on IPv6 VIP 1a156e674c8 qa: remove unused qa_scripts ccc40eb69b4 test/neorados: Don't leak watch handle d4ee87e985a neorados: Avoid double cleanup in watch/notify 4cc2dbe316b neorados: Actually enforce notification queue limit 89134791c16 neorados: Do not try to decode an empty response in notify f5affe06676 neorados: Go through linger_cancel on `io_context` shutdown 737f30f12c4 mgr/cephadm: return IP addresses in prometheus_sd_config a42cf8ea6c2 rgw/pubsub: fix uninitialized num_shards causing topic deletion hang f2dd6666a98 doc/cephadm: Fix more spelling errors 81ba57a3c60 doc/radosgw: Fix spelling errors e267ffa2ce4 os/bluestore: avoid redundant map lookup for deferred op 0b8a27aa978 mgr/cephadm: Fix mgmt-gateway default port in get_port_start() 93376e060aa mgr/dashboard: fix-add-node-issue a4292567ba4 mgr/dashboard: show miscellaneous data used 6dc6aeb7982 qa: Add nvmeof upgrade from v20.2.0 5f7cb0e216a mgr/dashboard: Fixing message when prometheus is disabled in performance charts Fixes: https://tracker.ceph.com/issues/75322 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> d499c7f30f6 qa/cephfs: do not validate error string in "fs authorize" tests 6e6e570f804 mon/AuthMonitor: add osd w cap for superuser client 34c0c8dc573 qa: ignore NVMEOF_GATEWAY_DOWN in nvmeof_scalability.yaml 86ac2893fbf qa/tasks/nvmeof.py: retry do_check if gw in CREATED 735490b4f15 rgw/test/multisite: revise test_period_update_commit zone selection for clarity 60666a28a8e rgw/test/multisite: revise test_period_update_commit testcase client wkld settings ba2dc12570c rgw/test/multisite: get_oldest_incremental_change_not_applied_epoch - handle sync-status failure gracefully 2a83b3e1cbe rgw/test/multisite: run sync status on the intended zone 95465d63aea rgw/test/multisite: test_period_update_commit use a custom retry setting d8a64898b49 rgw/test/multisite: use config's retry settings d0c466c7e63 rgw/test/multisite: add a mechanism to use custom config temporarily e23e1664ca4 src/msg/async/Event: collect and ignore return value for read() 80d50bab766 mgr/nvmeof: Adding missing CLICommand file to nvmeof mgr module 152af601f2a os/bluestore: add health warning for oversized BlueFS usage 9ad0fd3f1a5 script/build-with-container: add CONFIGURE_ARGS env var to configure step 48a9e88567d Revert "Merge PR #67630 into main" f7cf8ce1e65 mgr/cephadm: fix KeyError when host is removed during serve loop 5fcc8b0e46c qa/tasks/nvmeof.py: Fix tharsher daemon_rm revival 2565579caa1 doc/cephadm: Fix spelling errors 69a7c6bf151 mgr/dashboard: Breadcrumb should allow going back to subsystem tab 05db484cb69 mgr/dashboard: fix-nvmeof-subsystem-create-firefox-next 374e76e0684 mgr/dashboard: rename expand-cluster to add-storage cc8e8f02ce2 mgr/dashboard: update onboarding screen as per design b6a54e67cbc common/async: Fix removal from service list 503e2efd625 qa/suites/crimson-rados: add fio test case for osd shard number changes upon restart for 3 osd deb7bd134c8 doc/dev/seastore.rst: add design implementation for osd shards change 89a1f45e29d crimson/common/options: add seastore_require_partition_count_match_reactor_count in crimson.yaml.in 92b8c8f2269 crimson/osd/osd_admin: add osd command to dump store shards info 89d5be273a6 crimson/os/seastore: support other devices 77056321dad test/crimson/seastore: using store_index = 0 for the tests 2d866776b2b crimson/tools: fixing tools according to osd shards number change modification c6c613050c6 crimson/os/seastore: make register_metrics works for multiple store shards on one reactor 6c1aac7953e crimson/osd: replace store call by with_store call in case need remote store calling. 58601ac8a2e crimson/osd/shard_services: get multiple store shards for per local state, and use store index to create pg mapping 6530e2ae36e crimson/osd/pg_map: add pg mapping policy for osd shards number is different with store shards number 3530b5df517 crimson/os/futurized_store: support cross core store calling 7eb6e14356e crimson/os/alienstore: support multiple store shards on each reactor 763aef7b46e crimson/os/cyanstore: create multiple store shards on each reactor 3d97fe3dad6 crimson/os/seastore: create multiple device shards and store shards on each reactor. 1ad28ec1825 rgw/oidc: Allow thumbprints to be optional for oidc operations. fcf5370a00c compressor/zlib: Fix for ISA-L 2.32.0 build on aarch64 6744a43d1bc mgr/dashboard: Add secure and verify-host-name to "listener add" on NVMeoF CLI. Also add missing "manual" field in "listener list". 6930c426002 cmake: Add support for SVE instructions in ISA-L on aarch64 1d77955e836 include/ceph_features: note more kernel versions d92f83a8d30 doc: Update the POSIXDriver readme to current state 6943358fc79 rgw: set 2_min minumum on rgw_mp_lock_max_time f1ffb15b74e common: update crc32c to support ISA-L 2.32.0 a46428a1fd2 isa-l: Update isa-l submodule from 2.30.0 to 2.32.0 97f4043a646 qa: Add "auto_pool_create" to nvmeof_initiator 587d35bd59a mgr/nvmeof: add missing CLICommand to the module fdc072f15da mgr, qa: clarify module checks in DaemonServer 68221661b00 mgr, qa: add `pending_modules` to asock command bf25a08cc58 mgr, common, qa, doc: issue health error after max expiration is exceeded cbd1726fde0 mgr: ensure that all modules have started before advertising active mgr b7686d431cb rgw/multisite: 'bucket sync run' when executed during bucket full sync may fail to acquire bucket-wide lease. allow the command to run without a lock. however, the sync process and the command may race to update status obj. if the sync process does win the race, we must treat that as forward progress and retry -ECANCELED in ShardCR(), thus resuming from the updated marker. e03e04b3dfc mgr/dashboard: Remove the clear-alerts parameter from NVMeoF CLI e1b4457d857 test/crimson/test_interruptible_future: add UT cases for interruption handling in interruptor::green_get/yield/maybe_yield e32e8d251c5 mgr/dashboard: Initiator add shows success but host is not added/displayed in Subsystem Initiators table b2b2cd75200 crimson/common/interruptible_future: check for interruptions after the stack resumes 12167ed26ab crimson/common/interruptible_future: always throw the original exceptions 5cd67028784 mgr/dashboard: Footer actions shift upward instead of staying pinned at modal bottom in NVMe/TCP subsystem create wizard da1d9c79113 mgr/dashboard: Add restore events in notification screen 524e6c17a05 mgr/nvmeof: add nvmeof module introduction to pending release notes ebc661339ee mgr/nvmeof: add unittests 585f02869e5 mgr/nvmeof: use nvmeof module during orch nvmeof apply 94d21767f0a mgr/nvmeof: set nvmeof module to be enabled by default c39d87e49b8 mgr/nvmeof: intergrate module into build and debian pkg 8e9dc9cb40a mgr/nvmeof: introduce the new nvmeof module 52d46b496cb rgw/lua: create fresh VM for each background script execution dfda0da3257 test/crimson/seastore/test_seastore: add clone removal test ba24b2fc887 test/crimson/.../test_object_data_handler: add multiple clone/overwrite test case d005bea460e test/crimson/.../test_object_data_handler.cc: add support for clones 431886e18e6 crimson/.../transaction_manager: add logging to remap_mappings 26d78911319 crimson/.../lba_manager: add formatter for remap_entry_t d45a9880a54 crimson/.../object_data_handler: fix LOG_PREFIX for do_clone 34c639f30a3 crimson/.../lba_manager: convert remap_mappings to use cursors 01850b6b044 crimson/.../lba_manager: convert reserve_region to use cursor 3cb77cebd5d crimson/.../btree_lba_manager: simplify _update_mapping_ret, remove update_mapping_ret_bare_t 2010e8b6971 crimson/.../btree_lba_manager: convert _update_mapping to coroutine a463fd08ce0 crimson/.../btree_lba_manager: remove update_refcount, simplify _update_mapping return value c3aaeac3d13 crimson/.../transaction_manager: convert remap_mappings to coroutine d55901fd0a0 crimson/.../btree_lba_manager: convert remap_mappings to coroutine caa78ebb77f crimson/.../lba_manager: convert clone_mapping to use cursors 33e95b0400b crimson/.../transaction_manager: convert clone_pin to coroutine 4690f2b32e1 crimson/.../btree_lba_manager: convert clone_mapping to coroutine 31443e0f794 crimson/.../btree_lba_manager: convert get_end_mapping to return LBACursorRef 446c7450c56 crimson/.../btree_lba_manager: convert get_end_mapping to coroutine 722e193cc8c crimson/.../transaction_manager: remove LBAMapping update_mapping variant 8d1d5e88720 crimson/.../lba_manager: remove get_mapping interfaces f338a8845c5 crimson/.../transaction_manager: convert get_pins to use get_cursors 39e8beeca09 crimson/.../transaction_manager: convert get_extents_if_live and helpers to use cursors 87a5984b3ae crimson/.../transaction_manager: convert get_extents_if_live to coroutine 47f2cd1f1ca crimson/.../lba_manager: convert alloc_extents_ret to use LBACursor a7a9e75b054 crimson/.../transaction_manager: convert alloc_data_extents to coroutine d70d932bf4c crimson/.../btree_lba_manager: convert alloc_extents to coroutine 8a16bfe33d6 crimson/.../transaction_manager: convert rewrite_logical_extent to use get_cursor f4282a28333 crimson/.../lba_manager: switch alloc_extent_ret to LBACursorRef e8aacfd8ee4 crimson/.../btree_lba_manager: convert reserve_region to coroutine e8a632afc70 crimson/.../transaction_manager: convert reserve_region to coroutine 4c090654ec1 crimson/.../btree_lba_manager: convert alloc_extent to coroutine d5056ff9abe crimson/.../transaction_manager: convert rewrite_logical_extent to coroutine de39c8244ab crimson/.../transaction_manager: convert get_pin to use get_cursor 9ef189a600d crimson/.../lba_manager: remove remove_mappings dbd6830a4cc crimson/.../transaction_manager: rework _remove in terms of LBACursor interfaces e884dad8846 crimson/.../transaction_manager: avoid using LBAManager::ref_update_result_t cdb5f1daff2 crimson: replace LBAManager::complete_indirect_lba_mapping with TransactionManager::complete_mapping f66b5f60351 crimson/.../transaction_manager: simplify get_extent_if_linked f3b362c366e crimson/.../transaction_manager: convert _remove_indirect_mapping to coroutine 8a72b42b6dd crimson/.../transaction_manager: convert _remove_direct_mapping to coroutine d77dd171ee4 crimson/.../remove: convert to use cursor interfaces 241d9a7f240 crimson/.../transaction_manager: convert remove to use cursor interfaces ffe7e009244 crimson/.../btree_types: add LBACursor::is_direct 6af21979595 crimson/.../transaction_manager: convert _remove_indirect_mapping_only to use new interfaces d7e49d927ca crimson/.../btree_lba_manager: remove unused get_ref_update_result f5ef8def6ec crimson/.../lba_manager: replace unused incref_extent with update_mapping_refcount b37e880a85f crimson/.../btree_lba_manager: remove unused _incref_extent bbda6c17997 crimson/.../btree_lba_manager: convert remove_mapping to coroutine c03bb0bf6e0 crimson/.../lba_manager: switch update_mapping to take a cursor, add adapter b08c287cfa9 crimson/.../btree_lba_manager: convert update_mapping to coroutine 3579408ef60 crimson/.../transaction_manager: introduce resolve_cursor_to_mapping 445ef4c354e doc/dev/cputrace.rst: Documentation for groups 0f2662d7b14 mgr/dashboard: mgr/dashboard: Namespace size should accept GiB in NVMe/TCP ea73c23d4d1 doc/start: Improve beginners-guide.rst 7a85770068c crimson/.../lba_manager: add get_cursor interfaces e68754a8670 crimson/.../btree_lba_manager: convert get_mappings to coroutine f3ec12779ec crimson/.../btree_lba_manager: convert get_cursors to coroutine cb96a978cba crimson/.../fixed_kv_btree: add get_btree helper fb1d6847b12 crimson/.../btree_lba_manager: convert mkfs to coroutine 10277ddb8de crimson/.../transaction_manager: convert remove to coroutine 99d2cdfa16b crimson/.../transaction_manager: convert read_extent to coroutine d3ae5757aef crimson/.../transaction_manager: convert get_pin to coroutine 62eb603e1a5 auth/cephx/CephxKeyServer: un-inline methods to reduce header dependencies ba6b0d20481 auth/Auth: un-inline methods to reduce header dependencies 1d01de4ff62 auth/AuthMethodList: include cleanup 79908f45ede auth/CMakeLists.txt: add cephx/CephxKeyServer.cc to auth_srcs 97bbbae0635 rgw/notification: Send the correct RequestId in reponse to all sns topic requests. f0a9e90e553 rgw/qa: test notification Event is printing the correct x_amz_request_id. 8cd739c0a56 rgw/notification: notification Event is not printing the correct x_amz_request_id. 03cd298d1ee qa: fixing cephadm mgmt-gateway test to remove openssl dependency a07eed9eb6b mgr/cephadm: Fix alertmanager TLS and global security handling 7c1f623c439 mgr/dashboard: fix add host API path for namespace mapping in NVMe/TCP 9bf66dec4de test/ceph-helpers: add timeout to ceph pg query 5e10c3dfa3e mgr/dashboard: Fix breaking overview page 5cf596b9305 mgr/dashboard: Fix scrubbing state b8a824788c0 crimson/os/seastore/transaction: should consider non-aligned remapped extents when updating paddrs for TRIM_DIRTY/CLEANER transactions 6ac83c9fa78 crimson/os/seastore/lba: TRIM/CLEANER trans to adjust deltas of LBALeafNodes when committing them. 1efef08a2cd crimson/os/seastore: correct the exception condition when merging rewritten fixed kv nodes d54fe470d4b crimson/os/seastore/btree: make updates of lba leaf nodes ptrs synchronous with contents updates 6b28b8f9435 crimson/os/seastore/extent_pinboard: reset 2q_state when removing extents 0b7fb74361b crimson/os/seastore/transaction_manager: block client transactions if they conflict with rewriting transactions until the rewriting transactions finishes 64201c3887f crimson/os/seastore/cached_extent: treat extents under rewrite io as stable too 476c0eba4fd crimson/os/seastore: disable linked tree node operations when committing rewriting transactions bd0ce704f24 crimson/os/seastore/cache: rewrite transactions don't invalidate other transactions anymore 06d59ef2b53 crimson/os/seastore/cache: drop unused last_commit 077c0eeb084 crimson/os/seastore/cache: since extent committer will also set CachedExtent::prior_poffset, remove invalid asserts a3751735105 crimson/os/seastore/cache: unlink mutated extents from the stable extents' transaction views when committing or invalidating the transaction 95ae4b9086d crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing cfb615f3175 crimson/os/seastore/seastore_types: define rewriting transactions 4acc1cb47cb crimson/os/seastore/async_cleaner: renew backref cursors when they are generated by backref retrieval transactions and used by reclaim transactions aae47bd9eee crimson/os/seastore/lba_manager: make sure alloc_extents return viewable mappings 121e12572f3 crimson/os/seastore/async_cleaner: avoid its header dependence on backref_manager.h fffceb5fdf2 crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of lba/backref values bd8f53ba4bd crimson/os/seastore/lba_mapping: don't allow classes above TransactionManager to retrieve lba mappings' paddrs. ee24cf56461 mgr/dashboard: fix consumption chart units e16ae03b1d2 doc/radosgw: Improve language, formatting in s3_objects_dedup.rst bf02baa41f8 cephadm: avoid double counting NVMe devices in host facts c6abc0c3809 qa/suites/crimson-rados: enable cephadm tests 1832b1572cb doc: update mgr module command documentation for per-module registries 2e8b4b580cb crimson/admin/osd_admin: introduce reactor_backend command ae9ae0353e6 qa: suppress false positive delete map mismatch errors 80e668c03aa os/bluestore: fsck repair can now remove stray shards c7683aac5e3 os/bluestore: Fix fsck c7ea65c3ba7 store_test: Test for fsck fixing stray onode shards 380563b1fcd os/bluestore: Remove assert from NCB recovery 6b0c943c8bd qa: whitelist slow requests progress.yaml f766cc341cf crimson/osd/pg: drop inappropriate assertions 0a84e58121c .github: limit what CI checks run for only doc/qa changes 8e5492aa2c9 mds: Remove unnecessary std::move on scrub_summary in MDSRank::get_task_status e7534c24dc7 store_test: Test for NCB resilence 5e58b26b6aa doc: Document cephfs multithread mirror configs a8018b78dd0 qa: Validate datasync thread fair scheduling 9191490e294 rgw/dedup split-head Simplified check for shared-tail-objects. Added test for copy after dedup Use tail-ioctx when removing newly created tail-head cda345fa95c rgw/dedup split-head Limit Split-Head to RGW-Objects without existing tail-objects (i.e. obj_size <= 4MB) c1097980103 rgw/dedup: split-head mechanism Split head object into 2 objects - one with attributes and no data and a new tail-object with only data. The new-tail object will be deduped (unlike the head objects which can't be dedup) We will split head for objects with size 16MB or less c7b08218ad6 tools/cephfs_mirror: Remove additional wait in pop_dataq_entry 4578aa4393b mgr/dashboard: Fix snapshot Api firing twice 03818d2e6a2 mgr/dashboard: Add data resileincy panel be5b640860a mgr/dashboard: Add data resileincy card aee5756773a doc: Fix link and improve Crimson doc 593886ce27b qa: remove ceph-deploy configs with no effect 64e591b0fbf qa: remove long retired ceph-deploy 1827f86ab4c qa/workunits/smb: update QoS tests for burst multipliers and bandwidth units b076ea38b37 doc/mgr/smb: update QoS doc with burst multipliers and bandwidth units b09c5f41096 mgr/smb: QoS bandwidth pass-through and burst_mult parameter 945a23cc3a5 Revert "qa/rgw: the rgw/verify suite runs java tests last" 94799dc3b5a rgw: add teuthology integration for bucket logging tests b286ca57ad1 pybind/mgr: call new _ceph_exit for killpoints 378a21aa407 mgr: add ceph binding for exit 94195218b88 tools/cephfs-mirror: Introduce file batching for datasync threads f9b94274f2e rgw: add bucket logging pytest suite f418c03d345 doc: Improve start/quick-rbd.rst 711858a6cf2 tools/cephfs_mirror: Distribute datasync threads across snapshots f02a9ba1d53 qa/tasks/barbican: add kek for simple_crypto_plugin 39b580dba36 qa/suites/rgw: use 'member' instead of 'Member' for roles in barbican de062fad109 qa/suites/rgw: bump keystone to stable/2025.2 1c898b6092b cmake/cephfs: link correct Boost libraries for cephfs tools 9b617f518f0 cmake: create Boost::asio target with conditional uring support 8df5776c162 test/rgw: fix -Wstring-plus-char warning in test_d4n_policy 0ef66f6f2e1 qa: make test_progress atomically capture OSD marked in/out events 25ee0967e50 .github: mitigate possible "hackerbot-claw" exploit d0fd33e28ab mgr/cephadm: hardcode daemon type to mon 20990a0eb86 mgr/cephadm: mon public network updating 69e0e442427 rgw/d4n: Implement bucket check_empty and remove methods qa/d4n: Add delete testing to D4N suite 5dc28ce2227 doc: document the new locally_enabled field 25b373c8176 mgr/smb: configure smb service for new remote control local feature 8a7c55196d4 mgr/smb: add an option to enable the local variation of remotectl 954dbb02af8 python-common/smb: add the remote-control-local feature bf3c77d0be2 cephadm: add support for a remote control local socket cefe89cda63 qa/multisite: enable the multisite test for oidc. 1cd4b4c04d5 rgw/oidc: plumb RGWObjVersionTracker through load/store for race detection dc412a7e519 test/rgw/kafka: fix kafka relase to more recent one 18546fa92a0 pybind/orchestrator/cli: fix OrchestratorError retval sign c78636c7e75 cephadm: fix rm-cluster when /etc/ceph/ceph.conf is a directory 24d0fbb7071 qa/tasks/mgr: test_module_selftest set influx hostname to avoid warnings during plugin test 1886956a6f6 test: rados singleton-bluestore missing mds for cephtool tests 51e3c9afe0a mgr/dashboard: Use illustration image for empty state table 0383ca23e5c rgw/lua: fix a crash when D4N is enabled 6a015d8f578 python-common: Improve mgmt-gateway descriptions in service_spec.py b9038116d25 src/pybind/mgr/prometheus: Add five OSD metadata metrics to module.py 6c0ca320f94 rgw/oidc rados: add rgwrados::oidcs namespace abstraction for cls_user for accounts. cf74fb87703 mgr/rbd_support: Stagger mirror snapshot and trash purge schedules b3f35aef9d8 doc/rados/operations/health-checks: Added MON_COLOCATED health warning Update the Health Checks doc page with MON_COLOCATED warning 9ff3307d569 mon: Add health warning for colocated monitors In HealthMonitor::tick(), check ip addresses of all monitors to detect if any are on the same node. Create a HEALTH_WARNING if this occurs. Added standalone test. 3a666c64615 qa/suites/crimson-rados: first version of cephfs/ d5f37cd591a mgr/smb: reimplement part of the _search_resources function 875f6c3dd6c mgr/smb: rename func to map_resource_entry to make it public 2f29ca6db3b mgr/mirroring: json pretty formatting 8c0f0d568f5 mgr/dashboard: use __name__ for module-specific logging 9369434ba5a selftest: Add logging self tests a89e1760566 pybind/mgr/mgr_module: isolate logging per mgr module 2b2c07b0397 osd/scrub: extract_crc_from_bufferlist: fix off-by-1 error 581565585ec mds: scrub pins more inodes than the mds_cache_memory_limit 1a280b9a320 qa/workunits/rbd: fix unbound variable in status() 82717e43a08 qa/workunits/rbd: short-circuit status() if "ceph -s" fails 81a5906f0d1 qa: rbd_mirror_fsx_compare.sh doesn't error out as expected 5821d1b03e8 dashboard: add location field to NVMeoF namespace and gateway group APIs 17834439a33 rgw/lua: watch package allowlist post realm reload fec710c177e rgw/lua: fix package listing f551c110920 qa/tasks/keycloak: drop unused local variable c319e6a2770 fix upgrade remove invalid code from NVMeofGwSerialize.h put encode/decode at the file NVmeofGwMap.h 678e1b493c9 doc/start: Update and fix get-involved.rst 6e25724364c qa/cephadm: ignore transient CEPHADM_FAILED_DAEMON in smoke-singlehost b2d9dbb81e9 rgw: handle plain-text object tags in RGWObjTags::decode() fdf10845fea rgw/rest-oidc: Forward all oidc mutation request to master zone. f35001b4aa2 rgw/oidc: add rgwrados::oidc interface to support multisite. 13480dfe4a7 doc: reformat crimson docs a6b13f6ab0f qa: resolve py3.12 regression for random.sample c1a21a9c00a os/bluestore: add 'bluefs stats reset' admin socket command. df0028f0fe6 Revert "Merge pull request #67167 from Hezko/nvme-module-two" 07a7f6f5270 mgr/dashboard: add SMB share QoS rate limiting 24da933aaf4 mgr/dashboard: Misleading warning when no eligible devices are available for OSD creation bf07742aeeb crimson/os/seastore: fix experimental_list_directory iterator dereference 6d016afb543 crimson/common: fix metric label dumping f29e98fb5b6 cmake: explicitly support and enable vptr sanitizer ac04710781b seastar: bump up seastar submodule 4778a3d323e doc/radosgw: Fix markup in adminops.rst 9a9ca59658a rgw/cloud-restore: Restoring to non-existent storage-class should fail 0698fe715c8 Avoid calling zonegroup modify if realm/zonegroup/zone are not present in the spec de9e6021ae9 doc: Remove markup from CLI example commands d4a4d9b85bd doc/rados: Fix minor issues, improvements in health-checks.rst (4 of x) 10737de962a mgr/dashboard: Fix auth logic in subsystem and remove traffic encryption columns 6d3aaff9612 doc: Fix Sphinx warnings e4f6620a9f2 mgr/dashboard: NFS: Toggle visibility of CephFS snapshots c2e7fecd722 mgr/dashboard: add storage consumption card 3ebe3a0a432 qa/tasks: make rbd_mirror_thrash inherit from ThrasherGreenlet ee710390d27 rgw/tests: add os-specific java 1.7 install commands to keycloak task cd283667db2 mgr/cephadm: updated tests with osdspec_affinity 08ed13ab4c2 doc: document smb cluster resource log_level parameter 660f419328f mgr/smb: add support for configuring log level values 5d51d4c110a mgr/smb: add new log_level parameter to cluster resource spec 5648f573e6c mgr/smb: add a simple validation function for log level dict 1ad01f2e5e4 python-common/smb: add constants for managing smb debug levels a045b0f595b mgr/cephadm: pass tunables smb service spec param to binary 5b9ea741970 cephadm: fetch ctdb log level from tunables dict 997db839c93 python-common/deployment: add new tunables param to smb service spec b760a940d27 common/async: fix stack-use-after-scope in co_waiter aca4d32a48b mgr/dashboard: Add DHCHAP controller key to NVME host commands Fixes: https://tracker.ceph.com/issues/74939 3b1aac6e18c mgr/dashboard: Allow adding authentication to subsystem flow 5f1325f2efa crimson/os/seastore/object_data_handler: avoid reserving zero-length regions c3c7dc402ca crimson/os/seastore/object_data_handler: do_zero made to use coroutines 5a5dbc77db3 test/osd: Fix unittest_peeringstate message leaks 19621efa1c7 script/redmine-upkeep: do not warn for backport PRs 50a26e1b2fb script/redmine-upkeep: do not raise backport warnings for backports 8db0c8a4cc4 qa: allow multiple mgr sessions during eviction test 69f945912cf qa/tasks/quiescer: remove racy assertion af681d83c78 mgr/cephadm: spliting test_services UT into per-service UT files 2d12df2f690 mgr/cephadm: removed big test_services file 2e4a7e9bd2f test: Fix gcc warnings about subobject-linkage in ceph_test_rados_io_sequence 39d6b507b48 cephadm: fixing build_addrv_params function ipv6 handling 45d69c463f8 mgr/dashboard: Remove tabs under subsystem Fixes: https://tracker.ceph.com/issues/74904 3180812e541 rgw: Add Keystone scope information to ops logging 23bb563ed8b src/pybind/mgr: Add nvmeof-top tool afcc1fc3d31 mgr/dashboard: introduce NvmeofCLICommand's success_message_template and success_message_map parameters to allow meaningful success messages 003cc2753ef crimson/osd: Use for loop in PG splitting 6708b3169bc Revert "qa/suites/crimson-rados: disable PG splitting in radosbench workloads" 8f6ecea5736 crimson/osd: fix PG splitting logic during map gaps bbaa979157f mgr/dashboard: add-reviewstep-in-subsystem abc2cd078f4 mgr/dashboard: NVme- Add namespace in subsystem resource page 0290539e739 mgr/dashboard: NVmeof Add listeners in subsytem and resource page. bdacb3d7ab3 mgr/dashboard: Nvmeof add hosts(Add Initiator) in subsystem details 166fb04c125 mgr/nvmeof: add nvmeof module introduction to pending release notes eecbff76fa6 mgr/nvmeof: add unittests f5734cf41b1 mgr/nvmeof: use nvmeof module during orch nvmeof apply eccffe57c5a mgr/nvmeof: set nvmeof module to be enabled by default 901ec98b414 mgr/nvmeof: intergrate module into build and debian pkg 15fcbb5e3ea mgr/nvmeof: introduce the new nvmeof module 541439b2900 src/common/version: append vendor release to ceph version(s) output 943060fcc0b mgr/dashboard : Add cephadm config params to dashboard fixes : https://tracker.ceph.com/issues/75109 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> c7f545929df mgr/dashboard: nfs export creation fails with obj deserialization 1384ae37c70 mgr: isolated CherryPy to prevent global state sharing ff8a4a2a254 mgr/dashboard: Add filtering of alerts via route 05bb1431df0 mgr/dashboard: Add skeleton states for alerts card 1542265579e mgr/dashboard: Fix css in alerts card cc1923d5794 mgr/dashboard: Fix breaking layout in overview page 07ef68f3fcb qa/suites/upgrade: exclude rocky when Squid is involved 0d6a39d0b2c qa/suites/upgrade: update upgrade paths c230b3086e2 doc/CONTRIBUTING: link to Governance rules 06fda9d9454 qa/tasks: add Kafka SSL and SASL security testing support d98c6cc3f9f rgw/bucket_notification: enhance Kafka security testing afd5c02cf4f qa/rgw/multisite: remove unused assert_raises() and tools.py 787de5b24e2 qa/rgw/multisite: remove boto2 BotoJSONEncoder b801fa83b90 qa/rgw/multisite: move append_query_arg() to zone_es.py f16ef7a95ee mgr/dashboard : Update create/edit service modal to support certmgr fixes: https://tracker.ceph.com/issues/74636 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 0be3a7896be mds: use SimpleLock::WAIT_ALL for wait mask 2a405520fc8 mgr/dashboard: Fix unit tests bdbe9d2a4f1 mgr/dashboard: Added capacity metrics 0486d807ac8 monitoring: Add subvolume dashboard 5b9facb04e3 test/encoding: use setarch -R for ASAN builds in readable.sh 25319e985ad cephadm: fix EndPoint to handle bracketed IPv6 addresses 9ce443cb135 mgr/dashboard: Remove tabs under subsystem Fixes: https://tracker.ceph.com/issues/74904 ecb616681b5 test: disable known flaky tests in run-rbd-unit-tests ca33149372f mgr/dashboard : update telemetry notification for simple mode fixes : https://tracker.ceph.com/issues/75157 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 3ea6ee62aa3 librbd: don't complete ImageUpdateWatchers::shut_down() prematurely b5fe6fa3c40 rgw/lua: cache lua bytecode 541e660e7e3 Handle whitespace in upgrade daemon types f294488fef7 test: Fix unittest_peeringstate as 74218 has merged 7db2efc3907 PendingReleaseNotes: Mention improved mirror daemon status f46560baff3 doc: Document mon_host and fsid added 18fe850b64e qa: Validate mon_host and fsid in daemon status e813b6cac2e mgr/mirroring: Display remote fsid and mon_host in daemon status c8b5bbbb124 doc: add the Ceph Technical Charter 8b47e8e8360 erasure-code/jerasure: Fix thread safety in plugin init 98d14c47a67 mgr/dashboard: Nvmeof edit namespace size d0673eb510b mgr/dashboard: Fix remove host in subsystem resource page f7c31b43180 mgr/dashboard : Cephfs Mirroring Entity Deselect fix 2850b3f529b qa: use safe_while() to avoid racy checks in test_subvolume_metrics_lifecycle() 89e3ab0b928 docs: update docs with new metrics description b48a9235054 test: add tests for subvolume utilization metrics 90cfbfd3c3e test: add test for new MDS perf metrics c8f2964d97d mgr: add subvolume quota metrics to the manager a206a71056e mds: add new perf and subvolume utilization metrics 3596ca07709 librbd/mirror: detect trashed snapshots in UnlinkPeerRequest fcbb9c87884 mgr/dashboard: create-namespace 1a6ebae1e33 mgr/dashboard: Generic Performace Chart - Carbon Fixes: https://tracker.ceph.com/issues/74396 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 392f7008b26 mgr/dashboard: Fix nvmeof edit host key in subsystem resources page 027400df81a qa: fix TypeError in delay fa37283bbef mgr/dashboard: Add hardware tab to health card a7f557c3fb3 qa/radosgw_admin_rest: replace boto2 with boto3 9aa7f82664f qa/radosgw_admin_rest: pass endpoint to rgwadmin_rest() fdc44e58626 rgw/rest: RESTArgs::get_string() url-decodes query params 2a94847da7d qa/radosgw_admin: replace boto2 with boto3 699380055ad rgw-nfs: run quota threads by default 0de754e7185 mgr/dashboard: Added variations of alerts card sub total layout 0abb6837ace mgr/dashboard: Css fixes for health card and alerts card 7d90114b84c test/rgw/notifications: increase the max number of boto client connections 5e204e17684 test/rgw/notification: do not use netstat in the code 0d8a70b6d6c test/rgw/notifications: migrate from nose to pytest 8935c1f14bc test/rgw/notifications: fixes needed to run the tests in a multisite environment 8e9c77160d5 test/rgw: remove depracated boto dependency 8f970657632 test/rgw/notifications: cleanup of tests db08d851bc9 fix for quorum in API 9375b6e6fe9 rgw: only log errors in add_datalog_entry when error 07e9ab519ce mgr/dashboard: Add systems tab to health card 4b5096cc0de mgr/dashboard : Add certmgr alerts and warings to Prometheus and dashboard fixes : https://tracker.ceph.com/issues/73674 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 50177830211 mgr/dashboard: NVMe – Fix host,listeners namespace list display on Subsystem resource page 5a274dd73c3 cls/rgw_gc/cls_rgw_gc: read config via cls_get_config 02587347b0a nvmeof: Change the NVMEOF image version to 1.7 Fixes: https://tracker.ceph.com/issues/75097 2c079d55c19 qa: temporarily disable some mirroring test (see: https://tracker.ceph.com/issues/74984) 227f17ae092 qa: suppress MismatchedFree operator delete RocksDB a43af620a73 mgr/dashboard: Add alerts card 6485acda206 mgr/dashboard: Cephfs mirroring - Entity 8177e48e5c8 mgr/DaemonServer: Re-order OSDs in crush bucket to maximize OSDs for upgrade c63b188a9fb mgr/DaemonServer: Implement ok-to-upgrade command cf54988c504 mgr/DaemonServer: Modify offline_pg_report to handle set or vector types 0d41bdb7806 qa/workunits/smb: add tests for rate limiting 6f8fdc3a990 doc/mgr/smb: add doc for QoS support for CephFS-backed SMB shares 6072c667fb5 mgr/smb: add test coverage for rate-limiting 9078b91df6b mgr/smb: add rate limiting support 3724ab3e10f mgr/dashboard: Fix nvmeof namespace list and delete modal 4efa9e5f073 tools/cephfs_mirror: Fix lock order issue 1e4829589db doc: Document cephfs mirroring multi-thread b5ed4a7dd6e doc/PendingReleaseNotes: cephfs mirroring multi-thread 47ddc9bf46a doc: Document configs introduced with multi-threaded cephfs-mirror 9648d4610c3 tools/cephfs_mirror: Do remote fs sync once instead of fsync on each fd fd9319767a6 tools/cephfs_mirror: Don't use blockdiff on smaller files f6a6e781b88 tools/cephfs_mirror: Handle shutdown/blocklist/cancel at syncm dataq wait 6547e06a7b8 tools/cephfs_mirror: Handle shutdown/blocklist at syncm_q wait f9014ba3a40 tools/cephfs_mirror: Monitor num of active datasync threads 30472e8c1ea tools/cephfs_mirror: Store a reference of PeerReplayer object in SyncMechanism 80f46b72808 tools/cephfs_mirror: Make PeerReplayer::m_stopping atomic 3f4dea685a6 tools/cephfs_mirror: Fix assert while opening handles b02cc6ed30d tools/cephfs_mirror: Fix dequeue of syncm on error b1c5ec04a12 tools/cephfs_mirror: Handle errors in crawler thread 9d0ee76fb42 tools/cephfs_mirror: Handle error in datasync thread cfd56bc2de6 tools/cephfs_mirror: Add debug to capture file sync time 28d23381b9e tools/cephfs_mirror: Efficient use of data sync threads 07e758cb83a tools/cephfs_mirror: Make max datasync threads configureable 82fb3c93979 mgr/dashboard: Adding rados ns option into add_ns_req 0949e189f6e common: fix uninitialized nref in crimson CephContext 4628a9e9e23 mgr/dashboard: Add health check panel a2fcb3c9772 mgr/dashboard: Add health card 931226016f1 tools/cephfs_mirror: Synchronize taking snapshot 994ec7d61cb tools/cephfs_mirror: Add SnapDiff entries to dataq ce35fb5af4b tools/cephfs_mirror: Process entries from dataq 898b3917c69 tools/cephfs_mirror: Move dir_root to SyncMechanism 30f53fa9be0 tools/cephfs_mirror: Fix data sync threads completion logic ab0691c2c8a tools/cephfs_mirror: Populate dataq for RemoteSync cb13af3bd15 tools/cephfs_mirror: Move remote_mkdir to SyncMechanism 36a7acf3160 tools/cephfs_mirror: Mark crawl finished e151406be19 tools/cephfs_mirror: Add m_sync_data queue ac841895ed9 tools/cephfs_mirror: Add SyncMechanism Queue fadd270d66e tools/cephfs_mirror: Join datasync threads on shutdown 88436dc7685 tools/cephfs_mirror: Use the existing m_lock and m_cond ce0fe273eb4 tools/cephfs_mirror: Add a pool of datasync threads d39a2ee4150 test/rgw/lua: ignore hours for zero mtime 5882c17bbf8 mgr/rbd_support: Fix "start-time" arg behavior 58e49b9f5d2 common/options: change osd_target_transaction_size from int to uint fcda31aba95 librbd/pwl: fix memory leaks in discard operations 98f3454f0c1 os/Transaction: change get_num_ops() return type to uint64_t b677a496a0d qa/radosgw_admin: remove requestlog 1303415f489 rgw: `account rm` also checks and removes sns topics 070945ff432 qa/radosgw_admin: remove acl test cases 542875a100c mgr/dashboard: add schedule_level to image API for pool/cluster snapshot schedule dbf4e385f47 mailmap: update email address for Ville Ojamo 045d4168649 mgr/dashboard:revamp on-borading screen e28f6af07fd qa/cephadm: ensure host has been fully saved before considering bootstrap complete cc671a4f621 qa/tasks/keystone: restart mariadb for rocky and alma linux too 456eb5d2f65 qa/cephadm: fix test_set_mon_crush_locations test c507fa53a39 common/cputrace: Harmonize indentation a6d6be0f8a3 os/bluestore: Use cputrace groups for write path 916859aaf85 common/cputrace: Add groups b14012f3f60 os/bluestore: track compression_*blob_size* parameters for online update. 606502b831d qa/rbd/iscsi/cluster: ignore PG_DEGRADED warning e52dec075e8 cephadm/samples: don't specify localhost as grafana addr 56af318067a qa/cephadm: ignore CEPHADM_HOST_TIMEOUT_ERROR in timeout test 86ad0b891b0 rgw/beast: use strand executor for timeout timer to prevent concurrent socket access 915a5309a63 qa/rgw: bucket notifications use pynose e1a19538d5d options/global: raise bluestore_compression_min_blob_size_hdd to 64K 7923791baf0 mgr/dashboard: bump nvmeof submodule to 1.6.7 c6aa9deb16d os/bluestore: fix incorrect bluefs_used accounting when releasing old extents 87e3334de7b osd: Add unittests for PeeringState 59d0e2e2e31 doc: add docs for seastore support in cephadm 6eebd03175c mon/OSDMonitor: remove unused crush rules after erasure code pools deleted 512708a8e32 mgr/dashboard: Removed Raw capacity toggle 9432f0e5198 RGW/test_multi/RGWBucketFullSyncCR: test bucket full sync while source bucket is deleted in the middle a002beb6602 rgw: `account rm --purge-data` can delete users/roles/groups/oidcs too bffa11487cb librbd/cache/pwl: WriteLogOperationSet::cell can be garbage ebb5d25d151 copilot: add GitHub Copilot instructions 5e09d94d157 doc/radosgw: document account-root for PUT and POST /admin/user e075c3373d8 doc/radosgw: document account-id for `POST /admin/user` 442b45295f7 mon: Deny EC optimizations (fast EC) for non-4k-aligned chunk-sizes. 6b991a30fb0 doc/mgr: document new external ceph cluster support for smb 77b58e9ffbd mgr/cephadm: adding UT for certmgr health errors/warnings handling cbe2f6f613e rgw/restore: add configurable wait timeout for cloud restore read-through 1f2f2befc82 mgr/cephadm: validate hostname in NodeProxyCache a61bd5f0763 node-proxy: improve HTTP error logging in client 6db965b9946 node-proxy: get serial number instead of SKU d382bbcfd43 node-proxy: allow multiple sources per component 3eb664e5f7e node-proxy: re-auth and retry once on 401 0a4ad2fefc8 node-proxy: fix flake8 E721 in _dict_diff 7ff44704054 node-proxy: make the update loop interval configurable c6dae52d9dc mgr/node-proxy: fix "ceph orch hardware status --category criticals" 573b90050e9 node-proxy: normalize storage data per member 6566399b73c node-proxy: encapsulate send logic in dedicated method 97d2d0fe756 node-proxy: log actual data delta in reporter 6bc55026b55 node-proxy: add periodic heartbeats in main and reporter loops c9b7a306f34 node-proxy: adjust log levels 9797d9c44f8 node-proxy: add unit tests 11e00ad0070 node-proxy: add tox config for mypy, flake8, isort, black eca4404ba69 node-proxy: black and isort formatting pass 1d8a46cda45 node-proxy: fix mypy errors 6e5b46c1f64 node-proxy: handle nested Redfish paths for components 64fc7e4daf0 node-proxy: split out config, bootstrap and redfish logic 7848673c793 node-proxy: refactor config loading 179ad62844e node-proxy: add 'vendor based' redfish system selection a017e03d068 node-proxy: introduce component spec registry and overrides for updates 576817410ff mgr/cephadm: safe status/health access in node-proxy agent and inventory ef9405850b9 node-proxy: narrow build_data exception handling and re-raise ae7624321ac node-proxy: refactor Endpoint/EndpointMgr and fix chassis paths a505a2248bc node-proxy: use safe field access in storage update 007f33c5b92 node-proxy: reduce log verbosity for missing optional fields 380ebf0087a code review changes 67f3a7f594d nvmeofgw: disaster set/clear command, introduced disaster-locations map, changes in behavior of failover/failback, additional validations added 315da540478 nvmeofgw: added support to nvmeof stretched cluster: GW commands added : set location and set admin state enable/disable added start-failback <location> command. 0fe131187ab cephdm: add support for raw crimson OSD deployment ef83f0451e0 qa: Fix test_cephfs_mirror_restart_sync_on_blocklist c4bbd8e3b9c doc: update broken reference 29fb42e38e1 qa/standalone: osd-backfill-space.sh a67db327574 mgr/dashboard: Add apis for add/del hosts on namespaces 8c3774e53c2 client: During encryption of short case-insensitive file names, store raw ciphertext 9adbb8821d5 test: Use do_ceph_mount in ManyNestedDirsCaseInsensitive 5712016c213 mgr/smb: update the handler to support external ceph cluster type 7e506c06ef4 mgr/smb: update staging funcs to include ext ceph cluster resource 0cb64be6ee0 mgr/smb: add new external ceph cluster to internal store mechs 24a2e25fef0 mgr/smb: add external ceph cluster to sqlite store 6dbe276ff53 doc: update default availbility score status c0d530277fd cephadm: add tests for seastore support b5069eea224 cephadm: add support for seastore 124edb2e30d mgr/dashboard: delete-gateway-nodes c104328868f doc/crimson/crimson.rst: introduce Enabling io_uring efe8919d967 seastar: update submodule to wip-matanb-seastar-feb-26 c34da69f762 qa/test_mirroring: Fix flake8 errors e5abac30b2e mds: enable osdc op throttles 02ec6362284 cephadm: reapply hugepages for nvmeof at service start d73c88066a0 mgr/dashboard: Added unit tests e64a8396514 mgr/smb: add new external ceph cluster resource type b343f795595 mgr/smb: add new enum for external ceph cluster resource type 00b53a75138 mgr/smb: remove largely unused nuisance function 7ed7f02f62f mgr/smb: move resource types to class level 3e456ac1ce1 mgr/smb: avoid using thandler.generate_config function 39ee5b792bd mgr/cephadm: add external cluster config file contents 6fecea39eaa cephadm: add support for custom ceph conf/keyring files 902512fa8dc cephadm: let smb sidecars be extra-ified 2aba5e53946 cephadm: fix naming issue when using sidecars 48784fffe7b cephadm: add parent_identity function 229a0a2e71a cephadm: allow sidecar containers to make use custom configs 0e498c9f55d python-common/deployment: add class to defining smb external ceph clusters 76a3bbdd738 python-common/deployment: allow smb external store to use memory 73cb055b511 python-common/deployment: fix typo in comment in smb class b4c0377d440 qa/tasks/daemonwatchdog: fix unbound variable in bark_reason message 7f85b9ddb54 qa: krbd_rxbounce.sh: do more reads to generate more errors 68396f6337b rgw/lua: Add Lua functionality for blocking requests cd9d651fc8a qa: Fix coredumps caused by udisks f3749952a8b mgr/dashboard: support custom image for bootstrapping 868ed589f29 mgr/cephadm: add logic to handle certmgr errors and warnings eb3658a425a mgr/dashboard: add CephFS Mirroring enablement page 9c7e95e2910 doc/radosgw: change all intra-docs links to use ref (4 of 6) f042104d4d6 doc/radosgw: change all intra-docs links to use ref (6 of 6) c8a66a96e91 RGW/multisite/RGWListRemoteBucketCR: clear reused bucket_list_result to avoid stale listings ae59eac57f2 RGW/multisite: bucket_list_result object provides a method to reset its entries 3a9bf2c5cc7 RGW/multisite: add some more debug logs to sync codepath 8109a2e4460 RGW/test_multi: remove unused import b6ecd19be1d RGW/test_multi: allow Cluster object to run ceph admin commands 98276d90cd8 RGW: add delay injection options for integration testing c630f339c4f RGW: make SSTR macro safe against variable name collisions 0004c51704e scripts: ceph_dump_log.py change global context access fbe3a053c2a mgr/cephadm: verify spec service_id before applying f2f535e114b qa: Fix test_cephfs_mirror_remote_snap_corrupt_fails_synced_snapshot c1e827247bd qa: Add retry logic to remove most sleeps in mirroring tests 4024dd8c933 doc/rados/operations: Improve formatting in crush-map.rst 03ef619e79a test/test_bluefs: make a standalone test case to reproduce bug#74765 daebcfb8944 ceph-volume: skip redundant NVMe mkfs discards 4bf6df1d82c nvmeofgw : do not process starting beacons from GWs in DELETING state do not send unicast maps to GWs in DELETING state db874660231 common/options/crimson.yaml.in: allow seastar to select available backend cb9e1dca581 cmake/modules/Builduring.cmake: add URING::uring as alias 0dd96b84f0b src/CMakeLists.txt: Set Seastar_IO_URING based on HAVE_LIBURING 486da05fcbd CMakeLists.txt: Generalize WITH_*_LIBURING f95b264aabf CMakeLists.txt: find aio for CRIMSON or BLUESTORE 7240a99fe12 CMakeLists.txt: Move WITH_CRIMON before setting WITH_LIBURING 71f04ea0b99 vstart.sh: fix identation 8c64ea536cc crimson: Support io_uring as reactor backend option 004994d743e Added qurey data 21dc8ce7906 mgr/dashboard: Added tool definition tip 621c214d010 Added query tital and used capacity data 263ca92f8ea mgr/dashboard: Add storage card to overview page 3ec27ce4dca mgr/dashboard: use gray10 theme colors faec1b0a258 mgr/dashboard: add-gateway-nodes 4ed3144fc44 .github/workflows: use main branch for config diff 3f635e12ab9 qa/rgw: add test_account_migration workunit 3af27391af7 doc/dev/release-checklist: add release to redmine-upkeep trigger aae7ef3e8b7 .github/workflows/redmine-upkeep: run for release branches 48e05a55185 qa/standalone: wait for ceph pg dump pgs 7807e11ee41 os/bluestore: update volume selector after recovering BlueFS WAL in envelope mode. e65564e9d1d test/test_bluefs: reproduce volume selector inconsistency after recovering WAL in envelope mode. 42b25e52e19 os/bluestore: move RocksDBBlueFSVolumeSelector to BlueFS.cc 777783f4219 os/bluestore: rename/repurpose bluefs_check_volume_selector_on_umount setting. 035ea9265fa doc: correct spelling 21adf5a41ae libcephfs_proxy: log more information about the negotiation b26d82335cc libcephfs_proxy: implement client support for batched readdir 377b38bb33d libcephfs_proxy: create internal ceph_dir_result structure da11a28ae6f libcephfs_proxy: add the number of supported operations to negotiation d22b788a3d2 libcephfs_proxy: implement daemon support for batched readdir 5f2a366d611 libcephfs_proxy: define protocol for batched readdir 8380e802721 libcephfs_proxy: cleanup unneded variable 8f0217b5b0a libcephfs_proxy: fix include dependency 0b418393c1f qa: fixing the qa test in mon/misc.sh after adding beacon-diff feature e7c163eefa4 mgr/dashboard: NVme-gateway-resource 1974c7e151f rgw/multisite: use libfmt to format Date header 545f77e4813 mgr/dashboard: Cephfs Mirroring - Filesystem Selection e3de8c9c1f3 mgr/prometheus/test_module: Adding unit-test for new classes 2ef12b2ffa6 mgr/prometheus: metrics header for standby module ff257fc1f08 mgr/dashboard: bump nvmeof submodule to 1.6.5 7f4eaee30cb rgw/notification: fix reserved_size drift in 2pc_queue causing ENOSPC errors 6a02f6b4612 qa/standalone: add polling for PG log trimming in osd-backfill-recovery-log 55448804139 mgr/cephadm: add __getstate__ so OSD class can be pickled ec9648151ba qa/standalone: improve reliability of osd-backfill-prio test d6c81dce601 d4n/policy: Remove erase call from update c83a31e9004 rgw: do not re-init Rados in RadosRealmWatcher b369af5289e cephadm, ceph-volume: add tests for crimson OSD support bf71ac6747e mgr/dashboard: Add step two of subsystem create form cf436c5048c mgr/dashboard: add page header component e99f82f9440 libcephfs_proxy: identify and copy related keyring files 7bfba9f5b1a libcephfs_proxy: move function location bbe9687e192 libcephfs_proxy: add option to disable config copies 235fd846ca2 libcephfs_proxy: copy config files into a subdirectory and keep the name c417dd6c407 libcephfs_proxy: add option to specify the working directory ac744e20828 libcephfs_proxy: add helper function for robust snprintf() 9d28bdebf28 libcephfs_proxy: make configurable settings available everywhere 72bbe28ad87 src/common: fix from_iso_8601 had no exception define 5a901808dfe qa/standalone: shorten bluefs test durations 2de79c64420 qa/standalone: increase WAL volume size to 1GB 011b25d8038 test/encoding/readable: Add backward incompat checks 9d289ed14e7 workunits/dencoder: use readable.sh script instead of python script 9fc57f9ed1c qa/standalone: fix bluefs expand test case 58f0ff6fd67 ceph-volume: pass osd_type value to ceph-volume d46804392c3 qa/suites/crimson-rados/thrash: Modify osd_target_transaction_size e4ecf431548 mgr/cephadm: Change the default value of omap_file_lock_duration in NVMEoF spec file dc0a195b937 osd: Avoid pwlc spanning intervals 2401a109e2a Revert "crimson/os/seastore/lba_mapping: don't allow classes above" 275e450e0d2 Revert "crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of" e1dc5e508a4 Revert "crimson/os/seastore/async_cleaner: avoid its header dependence on" 27321d6c21e Revert "crimson/os/seastore/lba_manager: make sure alloc_extents return viewable" 08bc486fb81 Revert "crimson/os/seastore/async_cleaner: renew backref cursors when they are" ed2e2286c15 Revert "crimson/os/seastore/seastore_types: define rewriting transactions" 22f6f2a0aa9 Revert "crimson/os/seastore/cache: add facilities to synchronize data and states" a7111283161 Revert "crimson/os/seastore/cache: unlink mutated extents from the stable" 0678237a330 Revert "crimson/os/seastore/cache: since extent committer will also set" df6fc6f9b7e Revert "crimson/os/seastore/cache: drop unused last_commit" 62edced5352 Revert "crimson/os/seastore/cache: rewrite transactions don't invalidate other" c7f22e44964 Revert "crimson/os/seastore: disable linked tree node operations when committing" e47e16ba24b Revert "crimson/os/seastore/cached_extent: treat extents under rewrite io as" 41b761b44ed Revert "crimson/os/seastore/transaction_manager: block client transactions if" ac3258028e4 Revert "crimson/os/seastore/extent_pinboard: reset 2q_state when removing" df8d6756e47 s390x CRC assembly not requiring ELF execstack e0218826a30 erasure-code/isa: eliminate redundant map lookups 6ebb625669a qa: set column for insertion e6d10c23eb3 qa: bail sqlite3 on any error 1e0114bf279 qa: use actual sqlite3 blob instead of string f304daa74ac test: use json_extract instead of awkward json_tree a3a18d3b43f mgr/dashboard: Add application/json content type to api doc respones 77efb41aec4 doc/_ext: fix ceph_commands.py for new decorator-based command system 7428c23de9e rgw/test: fix rgw versioning test fix d58de5174d0 mon [stretch-mode]: Allow a max bucket weight diff threshold ce5dde87442 doc/start: Update Slack invite link in doc/start/get-involved.rst 56b2250a284 ceph-volume: single lvs call to speed up exclude_lvm_osd_devices 698aad2f940 doc: add instructions for deploying crimson with cephadm 4a9afd77c5a script: improve qa-summary.sh script e6d6776e765 doc: update foundation.rst c06bee965f1 ceph-volume: include LVM mapper devices in get_devices() cadd4a4f6cc kv/RocksDB: Add instrumentation to BinnedLRUCache 3029f0fcce9 PeeringState::needs_recovery(): log first missing item e32d3642996 mgr/dashboard: Cephfs Mirroring Wizard Fixes: https://tracker.ceph.com/issues/74200 08645c2ab86 src/script/build-with-container.py: fix a few spelling errors 6faba4c2df8 rgw: fix memory leak in RGWHTTPManager thread cleanup 87665b7aa06 mgr/dashboard: Step three subsystem creation form 99e46d2cf05 qa/tasks: fix import error ba6f16d694e test/erasure-code: Use memory comparisons that are safe on big endian arch 0ae8f31415b rgw/test: add more output in boto3 versioning testing 496d8da4402 crimson/os/seastore: Add progress logging to transaction processing 8dc4fbc19bc src/crimson/osd/pg: Add DEBUG logging to do_delete_work 66831bc8955 mgr/cephadm: Add IO statistics enable field to the cephadm NVMEoF spec file. b22d94960eb qa/workunits/nvmeof/basic_tests: use nvme-cli 2.13 93a142c7b3c doc/radosgw/s3select: add SQL LIMIT operator examples 608982ffe02 mgr/dashboard: remove trailing space from directory name 1d0c8c286cc rgw/iam: match value of Null condition bedcac2d538 rgw: reenable 'bucket stats' on indexless buckets d40ccd10f7b rgw/iam: typed_any/typed_none take x as forwarding reference 01d4deb7daa rgw: 'bucket stats' omits usage for buckets on other zonegroups ca6d5092128 rgw/rados: pass SiteConfig into bucket_stats() ac5a721450b mgr/dashboard: Fix footer of notification panel 7637cf6081c script/ptl-tool: supprt --debug-build to add debug flavor 8b1922bec98 script/ptl-tool: remove debug suffix on branch name a3509f6944f rgw: bucket_stats() uses local variable 'index' 389efba589e crimson: fix dump_metrics skipping metrics argument. Add minimal qa test for the fix. 2d2f2491ebe qa/standalone/availability.sh: retry after feature is turned on 1ce8bf541fa qa/suites/crimson-rados: disable PG splitting in radosbench workloads 91deafeb1bd qa/tests: wait for module to be available for connection 50acc9d39bd doc: unpin pip in admin/doc-read-the-docs.txt 3d08847abc4 qa/multisite: use boto3's ClientError in place of assert_raises from tools.py. tools.py should eventually be removed once all other dependent tests move to boto3 00ad83d3ab2 rgw/notification: Prevent reserved_size leak by decrementing overhead on commit/abort. f6f8626a43a mgr/dashboard : Add Certificate tab under service details fixes : https://tracker.ceph.com/issues/74429 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 9f81e3fcf15 osd: Add asserts to look for potential missing list corruption. ea27f511bf2 osd: Change rmissing map key from version_t to eversion_t 26394ca0698 mgr/prometheus: Use RLock to fix deadlock in HealthHistory b410701b7c7 qa/cephfs: lua to respect missing kernel in yaml 585992a1986 ceph-volume: support crimson osd binary 0fdc81bf3cd cephadm: add osd_type to orchestrator d93bcb4923c mgr/dashboard: Add step 1 for subsystem form d2d7107b4e9 crimson/os/seastore/cache: fix possible extent chksum error 82a41eb6b95 pybind: remove compile_time_env parameter from setup.py files d02c518eb3d pybind/rados,rgw: replace Tempita errno checks with C preprocessor f0786a74971 pybind/cephfs: replace deprecated IF with C preprocessor macro afad55f6ec6 ceph-volume: fix build on RHEL 10/python 3.12 90eb0612fd8 qa/multisite: test fixes d663359fae1 qa/tasks/rbd_mirror_thrash: don't use random.randrange() on floats 825ec0d9bb2 qa/workunits/rbd: use the same qemu-iotests version throughout e6b08ae02b5 qa/tasks/qemu: adjust NFS service name for Rocky 10 dffdcb6b02f qa/tasks/qemu: install genisoimage package 57cc9216519 osd: handle all the updated keys in OSD::maybe_override_options_for_qos b29668a660e docs: monitoring: Fix typo thughtput -> throughput 592e3a9846b qa/workunits/rbd: reduce randomized sleeps in live import tests d85265eab4f qa/valgrind.supp: make gcm_cipher_internal suppression more resilient 294c36143d5 osd: Add counter to peering so we can see how often we would try invalidating the stats. ebc6f270681 osd: Fix issue where it is possible for stats to be recovered incorrectly during merge operations. 57f54aeb77f debian: package mgr/smb in ceph-mgr-modules-core b8fef80b1d3 mgr/dashboard: fetch all namespaces in a gateway group a236e9ec298 mon/OSDMonitor: allow PG splitting for crimson pools by default b34da8f3f59 doc/dev: add sequence diagrams back to health-reports.rst eba1d94a9ab qa: clean up and simplify client 2 caps 4991d37fbaa mds: indicate whether SnapRealm is a subvolume in dump 2cd07acd52c mds: dump SnapRealm for src/dest in link operations ec6522987c8 mds: abbreviate snaprealm in CInode dump ec861dc8eac qa/workunits/smb: make the runner script easier to use manually 1bf2f9fe18a qa/suites/orch/cephadm: enable hosts_access tests abf31d849b6 qa/workunits/smb: add tests for hosts_access field 5e64774852d qa/workunits/smb: add utility module for cephadm shell commands 802b6f0e979 qa/workunits/smb: extend smb test config ab3e4d4e405 qa/workunits/smb: make the smb_cfg fixture module scoped db05a1a89f3 qa/tasks: add client node info to smb workunit config dump 9383728125a qa/tasks: embed use of ssh_keys task in smb workunit 50e8e6185db qa/workunits/smb: add hosts_access marker to pytest.ini 84f5b6fe311 doc/mgr: document the new smb share option hosts_access be1ee044d0a mgr/smb: generate smb.conf hosts allow & hosts deny values 7e5fea1b25d mgr/smb: add a new hosts_access field to the Share resource 1546d4463c6 mgr/smb: add a new host access enum 9587087faa6 python-common/smb: move network conversion validation func to common fe88748c120 doc/dev/crimson/seastore: Update SeaStore docs 2d2f37bb7c2 osd/PeeringState: handle race condition of RemoteReservationRevoked event for Backfilling state 8e6d3cdf0fb qa/suites/crimson-rados: Add pg splitting tests to crimson thrash testing 0f96267eff8 doc/radosgw: rgw_lua_max_memory_per_state defaults to 128K (not 500K) 745cece11e5 vstart: replace obsolescent egrep with grep -E e2ea24c5a7d pybind/rbd: move legacy_implicit_noexcept to rbd.pyx 0423b771b75 pybind: hardwire language_level to 3 91de0e1933b cmake: migrate Python module installation from setup.py to pip e79f35d4926 qa/workunits/rados/test_envlibrados_for_rocksdb.sh: Add Rocky support a6cf895c8c5 qa/workunits/ceph-helpers-root: Add Rocky support for install packages dff5020f068 doc/dev/crimson/index: add seastore to content list 9969d218611 doc/dev/crimson: Move seastore.rst to crimson dir ec868d5ca2e qa/workunits/rbd: drop randomized sleeps in "big image" tests f18fe5d15f7 qa/workunits/rbd: avoid unnecessary sleeping in stop_mirror() 2ab13d94f65 doc: Add bucket logging admin commands documentation 547338694a5 crimson/osd: add verbose DEBUG logs for OSD startup 5fda52de021 mgr/dashboard: Add Archive zone configuration to the Dashboard 2ac65bd7376 qa/suites/upgrade: Exclude ceph-osd-classic/crimson when installing LTS releases 3b7f26e2b7e qmgr/dashboard: Some refactors and bugs fixes 67c525e3b87 mgr/dashboard: NVme- Delete Subsystem 42a6d66346f mgr/dasboard : Injest certificate mgmt API into services API fixes : https://tracker.ceph.com/issues/74039 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> Assisted-by: Cursor 46d9f95ff1d crimson/os/seastore/omap_manager: remove config from omap_rm_key_range 5fb9da90b58 crimson/os/seastore: optimize rm_key_range by removing one leaf node at once. 6a0b00cb976 mgr/dashboard: NVMeof-Create Gatway group Form 3d1214b5ef7 journal/ObjectRecorder: Define `intrusive_ptr` functions in header bd83d006a79 mds: Include message types we make intrusive pointers for 5b81911b310 rgw/datalog: Move `DataLogBackends::head()` to `rgw_datalog.cc` 17cdc8f2c3c msg: Make `intrusive_ptr<Message>` functions available when needed 179d4cbca6d osd/Session: Move `Backoff` constructor to `Session.cc` d412d52bbd4 rgw: Include `<cstdint>` in `rgw_sal_config.h` ea218daf739 mds: Fully qualify some calls to `make_message` 91231d89b2d common/Formatter: Include `<cstdint>` b1c6f95a575 cmake: Remove `FindPython3.cmake` 6dfb84e8246 qa/tasks: update egrep to 'grep -E' 77135de7050 mgr/cephadm: add certificate support and service spec for node-proxy 69ffac28a52 crimson/os: fix multiple compile-time warnings on unused variables 60d7d4ec360 qa/suites/fs/upgrade: Exclude ceph-osd-classic/crimson when installing LTS releases 357a56bb186 test/ceph_assert: fix death test timeout with threadsafe style cc76cd45d5c ceph-backport.sh: clean function argument use and update GitHub help link 5d356715765 rgw/auth: a forwarded CreateBucket request in case of multisite has an empty payload hash computed for UNSIGNED-PAYLOAD. use that hash for the header 'x-amz-content-sha256' in AWSSignerV4::prepare() 4c4460a96af mgr/dashboard: side-panel enhancements 91e9f00a754 rgw: ops large budget caused by rate limiter was enabled and max_ops set to 0 fb26bcd9865 mgr/Gil.cc: simplify Gil(), ~Gil() 19a9981e8f6 mgr/Gil.cc: do not use PyGILState_Check() 239b0dc8a9c mgr: add mgr_subinterpreter_modules config 3438add3fc9 qa/multisite: boto3 in tests.py 47ad27cb2f3 qa/multisite: zone files use boto3 resource api c84efd9af5a qa/multisite: switch to boto3 in multisite test libraries 77947f9bbce rgw/d4n: Implement base cache API ops 823f6b60af1 mgr/dashboard: add CephFS mirror endpoints 1999ca6046d doc: Fixes a spelling error on the RATIO for PG scaling recommendation. 5e9336a9aa8 mgr/dashboard: Added cdsGrid to header af322a6ae9a mgr/dashboard:Added modal for notiifcation area 68226642963 mgr/dashboard: Added header action for tasks and notifications a83ebb5dfac mgr/dashboard: Added carbon grid be4e863df01 mgr/dashboard:Notification Footer+ Notification Page Fixes: https://tracker.ceph.com/issues/71738 A comprehensive notifications management page that allows users to view, search, and manage system notifications with a modern Carbon Design System interface. ee2d2fb2ff3 crimson/os/seastore/extent_pinboard: reset 2q_state when removing extents a156475f3f8 crimson/os/seastore/transaction_manager: block client transactions if they conflict with rewriting transactions until the rewriting transactions finishes ec66079995e crimson/os/seastore/cached_extent: treat extents under rewrite io as stable too 21d76b96732 crimson/os/seastore: disable linked tree node operations when committing rewriting transactions 5ba464e6050 crimson/os/seastore/cache: rewrite transactions don't invalidate other transactions anymore 33e63bc85fa crimson/os/seastore/cache: drop unused last_commit 7e72a79af75 crimson/os/seastore/cache: since extent committer will also set CachedExtent::prior_poffset, remove invalid asserts bfc1231e371 crimson/os/seastore/cache: unlink mutated extents from the stable extents' transaction views when committing or invalidating the transaction 2fc047c51f3 crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing 1696011379d crimson/os/seastore/seastore_types: define rewriting transactions a9c17a2c091 crimson/os/seastore/async_cleaner: renew backref cursors when they are generated by backref retrieval transactions and used by reclaim transactions e6fd2e87a18 crimson/os/seastore/lba_manager: make sure alloc_extents return viewable mappings 1aae6f34b68 crimson/os/seastore/async_cleaner: avoid its header dependence on backref_manager.h 5a24cac63a6 crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of lba/backref values 45726996d65 crimson/os/seastore/lba_mapping: don't allow classes above TransactionManager to retrieve lba mappings' paddrs. e37d02a3a59 osd: add pg-upmap-primary to clean_pg_upmaps c5c46e0b6c1 tools/ceph-kvstore-tool: fix crash on db close. 666200eeb86 rgw: enforce max max for reshard logs listings 2b5f0f4e739 qa: don't assume that /dev/sda or /dev/vda is present in unmap.t 452cfdddbbe mgr/dashboard: fix RBD mirror schedule inheritance in pool and image APIs cf04790bede qa: Disable OSD benchmark from running for tests. 866a468d37d Revert "qa/cephadm: add default container image name base" 457cb8b407d cephadm: retry cleaning old cgroups when it fails 006e47e9ca6 qa: krbd_blkroset.t: eliminate a race in the open_count test aa2898c94a1 ceph-volume: update argparse help output assertions for python compatibility f247b4e8229 ceph-volume: avoid Device() instantiation in lvm OSD filtering 5c66862687b qa/crontab/teuthology-cronjobs: Use debug flavor a0eea4e6001 qa/crontab/teuthology-cronjobs: Cleanup Crimson tentacle nightly 525afef2d0b container/build.sh: Use dedicated debug tags da9b2f15e73 container/build.sh: cleanup crimson flavors 7dd00caa6b4 pybind: add pyproject.toml to fix ReadTheDocs builds with pip 25.3+ fadc2b1cc26 cmake: fix undefined PY_LDFLAGS in distutils_install_cython_module a8fbf262663 doc/radosgw: change all intra-docs links to use ref (2 of 6) c89f8a06c10 doc/radosgw: change all intra-docs links to use ref (1 of 6) 77da5ac95b5 Revert "common/options: fix heap-use-after-free by using never-destroyed static" a8a26a52333 mgr/cephadm: When deploying the NFS daemon, include the NFS monitoring port in tcp_ports so the firewall allows the port db4950dc8b7 mgr/dashboard: NVme-Subsystem list 0ef647c8faf mgr/dashboard : Add Cert Status column to services page fixes : https://tracker.ceph.com/issues/74411 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> aa2216d8d5e mgr/dashboard: Add productive card component 8c409a8dd09 osd/scrub: operator abort: (not) handling in-the-mail scrubs 0884eec3cae osd/scrub: added the scrub-abort command d24a02f67a2 osd/scrub: support an operator-abort command d51c228883d osd/scrub: removing the unused PgScrubber::m_scrub_reg_stamp 531c30cd0b8 osd/scrub: removing the unused next_deepscrub_interval() 36ef0f86d55 mgr/dashboard: improve RBD group API endpoint documentation 9dd379182f5 libcephfs_proxy: make comment of PROXY_FEAT_ASYNC_IO more clear dc267c7b664 libcephfs_proxy: add client implementation of nonblocking fsync 3fe4a338197 libcephfs_proxy: add server implementation of nonblocking fsync 5fe0c3c95de libcephfs_proxy: add asynchronous handler for nonblocking fsync 0c25e5b8f8e libcephfs_proxy: add protocol definitions for nonblocking fsync ad708f4c695 monitoring: update NVMeoFTooManyNamespaces to 4096 ns ccdcbe93be3 mgr/dashboard: replace traddr with server_address and only keep it in listener related commands 3be0d81e56e doc/rados: fix links in operations/cache-tiering.rst 12eb9edc63b doc/rados: fix unbalanced double backticks markup 8740544c517 librbd: introduce RBD_LOCK_MODE_EXCLUSIVE_TRANSIENT 1f9396ff820 librbd: prepare lock_acquire() for changing between policies ff89abf5ddc librbd: fix RequestLockPayload log message in ImageWatcher 9159a2dd032 librbd: amend error message in lock_acquire() 828802d21a1 mgr/dashboard: Change side navigation to `Overview` de5f1e47156 mgr/cephadm: Fixed Keepalived behavior for failover e872693c151 mgr/cephadm: Add some new fields to the cephadm NVMEoF spec file. Fixes: https://tracker.ceph.com/issues/74446 f7f74e45542 monitoring: make cluster matcher backward compatible for pre-7.1 metrics c1329c99459 monitoring: upgrade grafana version to 12.3.1 dac670a2720 crimson/os/seastore/lba: add extent type to lba map values 28de7b1a1a0 crimson/os/seastore: skip backref operations for pure rbm seastore instancees 5899535841c osd: Fix memory leak of ECDummyOp 5073bde38d3 nvmeof: Change the NVMEOF image version to 1.6. 247f71d058c script/ptl-tool: fix typo 9a07fbf6e28 mgr/dashboard: Add new landing page component a33ba5d6a3e mgr/dashboard: fix notification & images cypress e2e failure 56dc9cd1682 crimson/os/seastore/lba_manager: add scan_mapped_space 586f64c8673 doc/rados: improve troubleshooting-pg.rst 49af82c1a85 doc/rados: use ref for links and improve links in operations 548146e3f8d rgw: rgw-orphan-list can continue with empty intermediate file(s) 4e57701c59d doc: fetch releases from main branch 7716e9d34f9 mgr/dashboard: fix rbd-mirror e2e failure 13dab758429 mgr/dashboard: Include executing tasks in notification panel 1bec1875c4d rgw/rgw_ssd_driver: Include `<asio/system_executor.hpp>` 53a9c9d788b {osdc,test}: Supply missing executors to a couple calls in post dce2c80dbd5 {test,rgw,tools}: Explicitly use Boost.Process v1 1dfe804c841 build: Disable `FindBoost` for Boost's included cmake config eeed5bc3cd4 dmclock: Integrate fully into Ceph project d5912059c67 pybind/cephfs: invoke fcopyfile() libcephfs API without holding GIL 2f97ec2ade7 doc/_ext: unbreak releases timeline if other than 3 active releases 6594f6c6cc6 rgw: ListRoles returns "Access Denied" for a regular user with valid allow policy 97321d4d1d5 src/osd/OSDMap.cc: Dispaly SUM of PGs in ceph osd df 7e668715b0e erasure-code/isa: fix cache collision causing buffer overflow c694c35bbfc osd/PrimaryLogPG: encode an empty data_bl for empty sparse reads 3fb179ec616 libcephfs_proxy: implement support for fscrypt b49ac690d97 nvmeofgw: fast-failover changes 2b78b553cb9 mgr/dashboard: carbonize service form cebeab01bd3 mgr/dashboard: [RGW-NFS]: User level export creation via UI fails with 500 - Internal Server Error a45f32e9b62 test/bluestore: fix memory leaks in ExtentMap.reshard_failure test 2940938b8c0 cmake: remove Boost::system linkage for boost 1.89+ e5be0906c39 doc/cephadm: more improvements to install.rst fedb51a21da doc/radosgw: improve DNS host name config in s3/commons.rst 1ab0a8cb726 common/options: fix heap-use-after-free by using never-destroyed static a5f727a8928 mgr/dashboard: NVme-Delete Gateway group b8032ba7239 rgw/posix: Fix return value for open call on versioned dir 41208b7df11 rgw/posix: fix memory leaks in BucketCache a6ec02a28ac mgr/dashboard: empty-data-message 927c01be798 qa/tasks/dnsmasq: preserve nameserver for future use f276f9fb4ae qa/suites/rgw/website: enable centos_latest 50528e01e5e mgr/dashboard: add get_subsystem nvme command a405097ffd9 vstart.sh: revert unintended allocator type change 856e550b37a src/mgr: make enum statically castable a4b9bf76a2c rbd: make enums statically castable 524c2b4e28b doc/cephadm: small improvements continued 1a396233eb9 doc/cephadm: small improvements to upgrade.rst de74c694c87 doc/cephadm: small improvements to troubleshooting.rst d67e18d822d mgr/dashboard: carbonize-delete-zone-modal b827a7113a7 rgw/dbstore: fix memory leaks in unittest_dbstore_tests 985c9607f66 cmake: guard unittest_global_doublefree with WITH_LIBCEPHFS 4f33bcbb3e1 test/mds: fix stack-use-after-scope in unittest_mds_quiesce_db 915a071c90f test/osd: fix buffer alignment issue in unittest_ecbackend 1cbed33eae3 mgr/dashboard: Generalized errors and validations in forms 1b155707a2b qa/cephadm: add default container image name base dc4abadb4d5 script/ptl-tool: allow setting private on QA issue 9c4983d21f7 rgw/d4n: passing the dpp to RedisPool::acquire to fix nullptr crash cc8a3a08457 script/ptl-tool: add option to explicitly push to ci 79d8a4b57f4 mgr/dashboard: add CRUD API endpoints for consistency group snapshots 2/2 a60c86ae0a8 osd/ECUtil: Fix erase_after_ro_offset length calculation and add tests cc2a296fd3a doc/cephadm: small improvements to operations.rst 8e8b2d96e41 doc/cephadm: small improvements to install.rst 0cc8ed58ccd doc/cephadm: small improvements to host-management.rst aaa5a9b3935 doc/cephadm: small improvements to services/index.rst 26d10b300e5 mgr/ActivePyModules: fix dangling string_view in get_perf_schema_python bdd59feb3a0 doc/cephadm: small improvements 74b67998e47 doc/rgw: correct typo in rgw_usage_log_key_transition a60cb8cfd7a doc/radosgw: expose rgw_multi_obj_max_aio info 007a4972efb cephadm/tests: updated test for crash daemon 416383038cb src/cephadm: updated crash dir creation 6bffd4771b6 mgr/dashboard: add indentation to the json output of nvmeof cli commands fb9906de100 script/ptl-tool: add CEPH-BUILD-JOB trailer support e042983a37c scripts/build/ceph.spec.in: fix rhel version checks d26e0af8a9a mgr/dashboard: Add full page tearsheet component 26676cf8d51 doc: fix most invalid directives missing a second colon 8b5fdda6dde doc/man: fix invalid directive missing a second colon 132a7259c90 mgr/dashboard: Add generic wizard component 582e9df86b2 doc/radosgw: Fix link to Intel QAT in qat-accel.rst 78a5d1f4157 doc/dev: Improvements to health-reports.rst (1 of 2) 2fce003f8d0 systemd services: fix installing ceph-volume@ ccdb47301d3 doc/rados: Fix link to Intel ISA-L in erasure-code-isa.rst 93822d3c6ba cmake: clarify WITH_CRIMSON help text d44e67cdc5f do_cmake.sh: support Fedora 43+ with Python 3.14 1a9d3d65898 io_exerciser: Handle the Remove case inside of the exerciser_model->applyIoOp method call instead of using a wrapper around this call. ea45d50e922 osd/scrub: change all dump_stream() in pg_scrubber.cc a174744c709 osd/scrub: rename legacy 'scrub_reg_stamp' field 7bb4322c2cf osd/scrub: improve scrub target dumps e42773a3e6b common/Formatter: add dump_named_fmt() method 5b69f5a9f76 test: Ensure primary_oid name is used consistently 26caf55aed7 test: Add option to not delete created objects b7fd12e5500 pybind/mgr/dashboard/tox.ini: use up-to-date rstcheck invocations 4f9be674e9d pybind/mgr/dashboard/requirements-lint.txt: re-pin rstcheck 6ac5d3ba42b mgr/dashboard: carbonize-delete-zonegroup-modal 2339937b947 mgr/dashboard: fix ns add and resize commands help cd23e940c14 monitoring: fix rgw_servers filtering in rgw sync overview grafana 15481e509b4 doc: Remove sphinxcontrib-seqdiag Python package from RTD builds 6dae09de6a5 cmake: fix liburing path passed to rocksdb e40a9476996 doc/rados: Fix Sphinx warnings in troubleshooting/log-and-debug.rst b409100bcab doc/dev: Fix Sphinx complaints in msgr2.rst a64ab390ee5 mgr/cephadm: Change the default of max hosts per namespace in NVMEoF to 16. 2a5a96b88f8 mgr/dashboard: fix typo in error when gw does not exist 5f16ba3a17a common/options: document log_to_stderr's conditional default value 26a0ce7ca68 mgr/dashboard: Cephfs Mirroring Listing d10ad900562 mgr/dashboard: fix multi-cluster context switcher ff02a7987ea mgr/dashboard: carbonise multi-cluster forms 86cf25b1af6 doc/start: Update Slack invite URL in get-involved.rst 36307be9261 'mgr/dashboard: Fix display of IP address in host page cd1bc10cdd7 mgr/dashboard: remove not needed 'cli_version' field from gw info command 1e575692214 mgr/dasboard : Carbonize pools form fixes : https://tracker.ceph.com/issues/68263 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> cad4fb072a7 doc/dev: clarify CRC generation techniques d3bc7c14b79 doc/dev: clarify meaning of `late_flags` in msgr2 8f68ae22585 doc/dev: fix headings in msgr2.rst 8b1d5da2529 rgw/dedup: Prevent the dup-counter from wrapping around after it reaches 64K of identical copies. Limit dedup from a single SRC to 128 Target copies to prevent OMAP size from growing out of control Tests cleanup 719b7498460 pybind: replace deprecated IF statements with Tempita templates c8645ca3caa test/run-cli-tests: install wheel before cram to fix build failure 599922aa582 debian/control: add iproute2 to build dependencies cbdd9c4b1f6 common: fix TrackedOp intrusive_ptr compatibility with boost 1.89+ 2aed28db1a9 mgr/dashboard: add CRUD API endpoints for consistency group snapshots 60fa799d547 mgr/dashboard: rename 'Zone Group' labels to 'Zonegroup' 9da5b3d7a55 rgw: refact by encapsulating io_context_pool to enforce lazy initialization 52aeababe46 mgr/dashboard: upgrade angular to 19 65dce5ee39b osd: Do not remove objects with divergent logs if only partial writes. 3c1c658ce36 doc/cephfs: add fscrypt to index.rst 19059b263e2 doc/glossasry: Add "CRC" to glossary 67b92b3a47c rgw: bucket index list can go backwards and may loop 15c829a37f5 Fix GHSA-p433-fp4g-pc2c 73f3507554d doc/rados: Fix minor issues, improvements in health-checks.rst (5 of x) 36fb920c5e8 mgr/dashboard: update teuth_ref hash in api test f87e567000e qa/tasks: fix SyntaxWarning for invalid escape sequences in vstart_runner.py 8a3fa46c1d4 doc/rgw: POST /admin/account doesn't require id/name bbe6f4fc975 osd: FastEC: always update pwlc epoch when activating 3afa69911f6 doc/rados: Fix minor issues, improvements in health-checks.rst (3 of x) 2cf8e4b095c cmake: build static seastar for release builds bbf51cf73eb doc/cephadm: Fix formatting errors and improvements in osd.rst b91c6fa4983 doc/rados: Fix minor issues and improvements in health-checks.rst (2 of x) b0be532df3e doc/rados: Fix minor issues and improvements in health-checks.rst 3ede3eea31b rgw: `radosgw-admin object put ...` broken w/ versioned buckets a1a3dc35056 neorados: Fix Neorados CephContext leak 4aa9e246f05 pybind/mgr: add per-module CLICommand instances to remaining modules 9fe5a643f43 pybind/mgr/dashboard: create DBCLICommand, use throughout d8acddcc0b6 pybind/mgr/tests/test_object_format: update DecoDemo to use fresh CLICommand a58d20cca38 pybind/mgr/smb: adapt SMBCommand to use CLICommandBase 776abe4f87c pybind/orchestrator,cephadm: replace CLICommandMeta 9099c682c25 pybind/mgr: mechanically fix simple users to not import CLI*Command 2d79ae64795 pybind/mgr/mgr_module: support per-module CLICommand instances and globals ff863981844 pybind/.../dashboard: misc automatic linter fixes d4a1f2b117a python-common/.../service_spec: implement ServiceSpec.__getnewargs__ to allow unpickle to work correctly f69069e114e mgr: serialize python objects sent between subinterpreters via remote a09408e3b6d ceph: fix a small error in the ceph command help b7a7d99dfb4 cmake: While building fio headers, reference to macro BITS_PER_LONG defined by the fio's build is not being used in our CMake based system for plugins. e068201f278 developer: Add name to maps 0b0c73ad860 install-deps: Replace apt-mirror 1b0f873162d osdc: remove implicit LingerOp reference between watch/unwatch 4064da7ce71 osdc: linger_register() returns intrusive_ptr<LingerOp> 72eb48e0418 neorados: NotifierHandler holds intrusive_ptr<LingerOp> 9456aa73689 neorados: Notifier holds intrusive_ptr<LingerOp> c0c146d37ae librados: aio_unwatch() delivers ENOTCONN to AioCompletion 8efed0df0c7 doc/ceph.rst: scrub-related 'tell pgid' commands 7768363e622 doc/mgr: Fix collection desc in telemetry.rst 25905e7bd0a doc/dev: document exact CRC parameters for crc32c used in msgr2 a02f6b03710 test/crimson/test_crimson_coroutine: introduce repeat example e0a671aac77 script/gen-corpus: cleanup and improve readability and performance 1c319447f8f doc: Fix minor formatting, typo etc issues f6fdca0ec84 mgr/dashboard: bump validator.js to 13.15.23 a8f9f92b011 mgr/dashboard: emit success and error on copy2cliboard 25644b4bdd1 Fixes: https://tracker.ceph.com/issues/74162 0cc1664dc3b doc/monitoring: fix typo s/Orometheus/Prometheus/ 5f102ea0ab4 run-make: Added flag for Dashboard and WError Added flags to make Dashboard and WError optional. This should not impact existing pipelines as these options are disabled only when the flags are present. Signed-off-by: Anshuman <anshuman@ibm.com> a05be749972 doc/radosgw: Update formatting in notifications.rst cef061df818 doc/start: Fix stray RST syntax in documenting-ceph.rst 2527e6f6592 qa/rgw/upgrade: don't randomize distros a264963cbe4 qa/rgw/upgrade: exclude ceph-osd-classic/crimson on squid and tentacle f5c175949c1 rgw/lc: reuse prefetched object tags across lifecycle filter a47c63ba0a7 rgw/lc: change from spawn-per-rule to spawn-per-object 96370138754 rgw/lc: group prefix rules 60c96104612 mgr/dashboard: add API endpoint to delete consistency group 70c26cfb441 mgr/dashboard: Adding QAT Compression dropdown on RGW Service form Fixes:https://tracker.ceph.com/issues/74046 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 5b4f7373655 monitoring: fix CephPgImbalance alert rule expression 0f3775df199 qa/suites/upgrade: add "OBJECT_UNFOUND" to ignorelists 13b619aa115 qa/suites/upgrade: ignore "osd down" cluster log variations 520a9d0b175 qa/suites/rados/thrash-old-clients: ignore warnings about peering PGs 339c2eaf776 qa/suites/upgrade: add expected filesystem warnings to ignorelist 3636dc3598b nvmeofgw: prevent map corruption while processing beacons from deleted gws e55ad7bce2f mon: add NVMEOF_BEACON_DIFF to mon_feature_t and mon CompatSet 95808091308 mon/MonClient: add get_monmap_required_features() helper 3555a28e45c nvmeofgw: beacon diff implementation in the monitor and in the MonClient. 65282be6d3e Fix the prometheus module crash 118c5be6b52 test/ceph-helpers: Pass timeout and add timeout for commands in test_pg_scrub 9f1c8f94470 debian,ceph.spec: fix ceph-osd upgrade conflicts cf68949556a src/common: Add a destructor to shared_mutex_debug 745df6b7902 erasure-code: Enable isa for ppc64le target. 65e2a33ee7b deb/cephadm: Don't assume a home directory is configured baf4d47b2d5 doc/rados/operations: Clarify exiting in stretch-mode.rst c0f8290ff2f doc/mgr: fix some wording issues 8b50c4c951d doc/mgr: prefer the word interface over device 1fb6cb24f3f rados: Add API to disable version querying with reads in librados a7c4259ba0d mgr/cephadm: Handle ganesha-rados-grace tool failure d559c50770d ceph-object-corpus: pick up 20.2.0-380-gdbcbbd3f281 ceph-object-corpus submodule 271d2f9660e mgr/dashboard: where the alert page tag colors are not being applied 1f691aff54a Fixes: https://tracker.ceph.com/issues/74089 9d346d7cadc mgr/smb: Allow whitespace in share login names 0755593b4c8 'mgr/dashboard: Carbonize Block Module > NVme-Listing Gateway group 8213d4e5b0c qa/tasks: disable ulmits+coverage wrapper scripts for smb workunit 615901bfe69 qa/orch/cephadm/smb: add new smb.workunit task (non-AD) 5014fbcb98b qa/orch/cephadm/smb: add new smb.workunit tasks to some AD tests b8136a39a64 qa/tasks: add a workunit wrapper function to smb.py cf8fff7b98b qa/workunits/smb: add test_simple_smb.py very simple smb tests 50a9ac08721 qa/workunits/smb: add conftest.py for pytest fixtures, etc. 6307c1506e1 qa/workunits/smb: add smbutil.py a testing utility module 11a672a8807 qa/workunits/smb: add a stub pytest config 3e4c8a6d668 qa/workunits/smb: add a stub workunit script for smb testing e4855895a9f librbd: fix ExclusiveLock::accept_request() when !is_state_locked() 3327001c8f6 librbd: add ExclusiveLock::accept_request() overload 8375da4c5a7 doc/mgr: add examples to ceph smb cluster create and share create afa9210666f doc/mgr: various fixes and improvements for smb mgr module doc b844692d102 cephfs offline tools: DataScan cleanup 8aad846cb4d qa/cephfs-data-scan: Add progress update tests be4fb123532 cephfs offline tools: Update progress tracker docs 119fe914949 cephfs offline tools: add ETA logic in relevant commands 3e9391074c1 qa/standalone: Add a test for running repeer on simple ec and rep pools 02f69a39208 mgr/dashboard : Fixed labels issue fixes : https://tracker.ceph.com/issues/74078 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 82063f99024 qa/workunits/rgw: drop netstat usage d6bc0c5be86 RGW: Change prerequest hook to run after authorization process 489e64e8bf9 include: add flag to identify scrub IO 401cffadaf6 os/bluestore: add flag to identify scrub IO cd4dc8640de osd: add flag to identify scrub IO 46e574a616d cephadm/nvmeof: enable rbd_with_crc32c by default 58789dce8e4 rgw/radosgw-admin.cc: use new apis for admin cli command 2461b1bef3d rgw/adminops: support for adding restore operation 85079cf729e minor changes requested by reviewer 00b36052d0f rgw/dedup: Add support for RGW versions. Dedup code will scan all instances of versioned objects and include them in the dedup process 06b64533a45 doc: add ceph.conf in osd creation 33ecb7912f1 doc/start: Add ARM support note to hardware-recommendations.rst e34067f8cea rgw/reshard: bucket reshard may race with bucket index update. guard_reshard() serves as a wrapper to protect bucket index operations against concurrent resharding. but it only handles -ERR_BUSY_RESHARDING if bucket index update is already in progress with bucket shard assigned, and a concurrent resharding operation deletes this old shard object, there may be a window of operations targeting the old shards failing with -ENOENT. this error is not caught anywhere in the calling functions. as a result we could end up with objects in an inconsistent state. 575f9efac7c crimson/os/seastore/lba_mapping: Introduce co_refresh 95d0c2cc0c5 crimson/os/seastore/cache: Verify crc prior to complete_io 3d89478817e crimson/os/seastore/cache: get_absent_extent to accept pin_crc eb38c065dd9 crimson/os/seastore/transaction_manager: add logs pin_to_extent 9415aa54a7b crimson/os/seastore/transaction_manager: pin_to_extent_by_type into coroutines 7531c8115af crimson/os/seastore/transaction_manager: pin_to_extent into coroutines 58fd558cb82 crimson/os/seastore/transaction_manager: add logs to remap_pin 216f245cc84 crimson/os/seastore/transaction_manager: remap_pin into coroutines 78d29e2a06d include/cpp-btree: fix array bounds warning in child() accessors 80d759de0cb mgr/dashboard: fix nvme certificate name d91f7453721 crimson/os/seastore/transaction_manager: Move CRC_NULL checks 832d2836b17 script: sanitize git branch names for OCI tag compliance a4108d96629 doc: Use validated links with ref instead of external links cc04bef6218 crimson/os/seastore: Introduce check_full_extent_integrity helper 585b64d0777 cmake: convert erasure_code and json_spirit to OBJECT libraries 6075be4821e osd: Fix fast EC truncate to whole stripe aaa0bf7ce8a RGW: remove custom copy constructor for RGWObjectCtx and enforce no copy/move fef12f85535 .github: Harden workflow against arbritrary code injection d9b8ca1af8d mgr/dashboard: add API endpoint for consistency group name update 01c85255bc9 mon/MonMap: Dump addr in backward compatible format a14b34a974d test: Add test for omap_rm_range function in a replica pool a6ab6c63853 debian/control: record python3-packaging dependency for ceph-volume d400aa003f8 os/bluestore: add omap_bytes perf counter. df3a38ca122 os/bluestore: show RocksDB sharding information 5a13df1c8c6 os/bluestore/bluefs: Fix stat() for WAL envelope mode d78e0f22b6c osd: Deleting PG should discard pwlc f261379edcd pybind: remove deprecated PyEval_InitThreads() calls 6c3675cb831 librados: Add omap_rm_range function to ObjectWriteOperation 5fc716bf9f7 qa: exclude crimson from random-objectstore 18cb6bf5ad9 mgr/PyModule: clear Python exception when NOTIFY_TYPES is missing 537465aba0e src/test/crimson/CMakeLists: include dmclock 435a5df10fb crimson/CMakeLists.txt: include dmclock b011424ea2a crimson/mclock_scheduler: Support mclock for crimson 0395f84eb64 crimson/background_recovery: switch to unified SchedulerClass and introduce get_average_object_size for pg d932f98c3ab crimson/osd: Refactor crimson scheduler wrapper 888aaae4168 crimson/osd,osd_operation: initialize mClock scheduler, detect rotational devices, and run OperationThrottler background task 313741faf04 common/mclock_common: Declared MonClient for crimson in mclock_common fb7236e5593 mgr/dashboard: Rename Alerts tab to All Alerts 06188d0b205 rgw/rados: fix init/shutdown order for RGWIndexCompletionManager 2d843085a66 os: drop KStore 6bf91e4f6e4 include: detect corrupt frag from byteswap 7fdf680c137 test/encoding: print context on diff failure 1d526c50de0 mds: dump frag_t as an object 4fb5ad4a258 common/frag: produce valid fragments for test instances 647de21c85f common: simplify fragment printing 9e3837c837b common: properly convert frag_t to net/store endianness fa4078adfc4 mds: include sysinfo in status command output 3b63dc2aedb mds: drop checking CEPH_MDS_OP_SETLAYOUT two times f5235ab2d8e crimson/os/seastore: fix do_transaction_no_callbacks logs daf034e668a orch/cephadm: Fixes a unlimited env append in cephadm agent 24aea195e9e rgw: fix overflow of outstanding counter in SimpleThrottler d92083b42f5 osd/SnapMapper: more efficient object list generation in get_objects_by_prefixes() 7fadf6a8d46 mgr/TTLCache: fix PyObject* lifetime management and cleanup logic be28901f361 mgr/prometheus: prune stale health checks, compress output 88cd10fbb90 qa/cephfs: add ceph-osd-{classic,crimson} to exclude list of LTS releases b372872d62a rgw/multisite: drain children before collect() returns error in RGWInitDataSyncStatusCoroutine() c07d37d1908 qa/d4n: Update host checks d12d0ceb1b8 test/d4n: Add temporary eviction testing de1aed09255 rgw/d4n: Add yield parameter to get_free_space d6c53c55461 qa: test subvolume snapshot visibility flag post upgrade f40f4cee940 mds: update older versioned sr_t struct(s) to incorporate snapshot visibility flag c77be615ebe doc: remove redundant note about tested container hosts 86b0a158d07 doc: remove old distros from os recommendations 3d04c97d796 cmake: fix for -DWITH_BREAKPAD=OFF d7eb3cea8e2 mgr/dashboard: add API endpoint to delete images from consistency groups 7135c9c6513 osd: fix ODR violation in max_prio_map cb825ef6040 test/rgw/logging: run teuthology on erasure coded pool fcc52298b0e rgw/bucket-logging: support for EC pools 7f8460ae99d mgr/dashboard: support custom prop for table item redirection 61e3ce833f2 mailmap: update affiliation for Xinying Song 96200fbfc25 qa/standalone: osd-scrub-dump.sh: additional tests 7cc1e32180e osd/scrub: extract the 'read object data' functionality bb05e30092f osd/scrub: do not attempt to read past the end of an object 4f50887c1f7 osd: provide fmtlib formatter for ScrubMapBuilder 2ccb8385b77 mgr/cephadm: add rbd_with_crc32c parameter to nvmeof service spec e2af5a8266f osd: Perform shard look up correctly in partial EC writes e93f35520d5 Fix install-deps.sh script when crimson flag is disabled. d8d82a6c003 mgr/dashboard: fix multi-cluster route reload logic ea9588e3304 qa: Reduce number of osd threads when using compression 3693e835b0a osd: Restrict logging in MissingLoc::add_source_info c0c02d747a7 osd: Increase log level for listing missing list 7264ee9e434 osd: reset_tp_timeout should reset timeout for all shards 5e6a9c8f9de RGW/test_multi: testcase for rgw instance hang/crash during realm reload fbbbaa123a7 mgr/dashboard: add GET endpoint for CephFS mirror peers list and daemon status 39974503b2f doc: remove os recommendations for eol releases 97c24aaaa84 doc/dev: add os-recommendations.rst to release checklist 459df3293a6 doc: add Tentacle to os recommendations 5ad48c95e14 doc: remove Octopus and Centos7 from os recommendations 38224140844 common/options: document osd_deep_scrub_stride d27e99e9699 cephfs.pyx: use openat() in rmtree code 6ba23f5607f cephfs.pyx: use fdopendir() in rmtree() e7916ceac76 cephfs.pyx: use unlinkat() instead of rmdir() in rmtree() 550b2956359 cephfs.pyx: use unlinkat() in rmtree() c6ba8f7e26b test_cephfs.py: add tests for openat() python binding 4b5b288dcbf pybind/cephfs: add python bindings for openat() 79a7bcf41ce test_cephfs.py: add tests for fdopendir() 7e1009074fd pybind/cephfs: add python bindings for fdopendir() dff445ec797 test_cephfs.py: add tests for unlinkat 0e0f224a0f1 pybind/cephfs: add python bindings for unlinkat() a7f5df78d50 test_cephfs.py: update test_rmtree_no_perm_on_nonroot_dir_suppress_errors c07bcaf948c cephfs.pyx: in rmtree don't notify parent dir until traversing... 65dd5431d5d cephfs.pyx: in rmtree(), don't run rmdir() to figure out if a dir... e55159328e6 qa/cephfs: add sleep to test_rmtree_aborts_when_should_cancel_is_true fc5e863f720 test_cephfs.py: rename few tests in TestRmtree ce83aa10293 cephfs.pyx: rename class NonRecursiveRmtree and rmtree() in it b3774c8d0b1 test_cephfs: add test for rmtree() where path passed to 9f0194c7d78 test_cephfs: declare tests in TestWithRootUser as regular methods... d0724a26378 osdc: Add SplitOp capability to Objecter ee651d18862 osdc: Fix minor typo 6a24afdfdba osdc: Interface to allow split reads to copy op from client op to split op 3e6c66f132d osdc: Add stub for ability to force an op to always go to a particular shard ae57b8066e9 osdc: Split handle_osd_op_reply into two functions 39d5c7f8678 osdc: Remove unused con parameter from Objecter::_calc_target() c3f6bfb5071 osdc: Interface to submit IO with ASIO Post. 3202d9cb46f osd: Call clear_repop_obc for EC as well as Replica. 127457a85a6 osd: Implement sync reads and sparse reads for EC for direct reads c4370146748 osd: Add extent_to_shard_extent interface to PGBackend. 332b547ff8e osd: Set the from shard in the EC read reply. ce0b1ed93d1 osd: Generalise can_serve_replica_read for consumption by EC. d9f4ee45966 osd: Create EC Direct Read flag and pass through to EC. 454ea7cdee3 osd: Replace unused EC offset translation function with useful one. ac8816c9703 osd: Introduce pool flag for "split IO" and Plugin flag for "direct read" 7dab2c81f5c add Sagar Gopale to githubmap mailmap organizationmap Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com> 30b3baba4e0 Objecter: respect higher epoch subscription in tick 034eb49a9ce encode: Fix bad use of DENC_DUMP_PRE 054ae2a7c7e doc: Fix Sphinx warning about theme option 36d99e37cdb librbd: store CRC32C with initial value -1 to match msgr2 validation 4659e5800cc doc/release: Fix Sphinx warning in tentacle.rst 08e57cbee7c doc: Fix Sphinx warnings a899d9658cc doc/cephfs: Small improvements in fscrypt.rst a40f5bbd7c4 mgr/dashboard: fix server side table sort 002463f274b RGW/test_multi: add a helper function to check whether data-sync is making progress 8ab91a4f8e2 RGW/test_multi: add a helper function to get data sync oldest incremental change 97501cb49f2 RGW/datalog: do not try to add entry if changeslog is shutting down e777558c212 RGW: prevent RGWAsyncRadosProcessor from queuing requests during shutdown 53015492b53 RGW: set down_flag early on sync processor threads during shutdown 49627a22fac RGW: add RGWRadosThread::set_down_flag() helper 16e477d2099 rgw: fix offset calculation in copy_obj_data b028a41e1f0 mon/HealthMonitor: avoid MON_DOWN for freshly added Monitor c5b43e9b276 mon: add time_added to mon_info_t 62c449e208a common/options: add missing runtime flag 42a37916ff5 mon/MonMap: cleanup initialization ca892e3a4cf cmake: disable WITH_BREAKPAD on power arch 1ba55a20be1 cmake: use cmake_dependent_option for WITH_BREAKPAD 7f388199b5a neorados: specify alignments for aligned_storage eaae5df9aa1 qa: update release-checklists with encoder suites updates 9dec4901684 qa/suite/rados/encoder: update release N-2 for ceph-dencoder tests d0acd150130 mgr/dashboard: Remove ng script f73f3be5bb8 mgr/dashboard : fix - CephFS Authorize Modal Update issue fixes : https://tracker.ceph.com/issues/73854 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 57793524f24 doc/cephadm: Fix command plus improvements in service/mgmt-gateway.rst aec9589159a qa/clusters/crimson: increase reactors count 2d43f598b8f mgr/dashboard: Carbonize the Change Password Form 3fcc9e35cb9 qa/suites/rados/encoder: exclude ceph-osd-* when installing LTS releases 6b170bb5366 qa/tasks/mgr: test_module_selftest set influx hostname to avoid warnings 4f48af0d014 debian: remove invoke-rc.d calls from postrm scripts 5d6c4f1df62 rgw/notification: add negative test case to test boost:parse:url. b4fa87d24fc doc: Improve start/hardware-recommendations.rst 0cb34ec6645 mgr/dashboard: edit realm modal not working 57d081d6b5e mgr/dashboard: service creation fails if service name is same as service type e4d68354c9e rgw: sanitize copy source attrs 8f40f8d616e rgw/notification: According to RFC 3986, IPv6 addresses in URIs must be enclosed in brackets. e10612c291a rgw/notification: use boost:uri to parse the url instead of std:regex d6dd7ce5c3c mgr/dashboard: add GET API endpoint for consistency groups 5d4a47fe2c3 osd/SnapMapper: fix Crimson logs caef812aa63 rgw: verify sse-c headers on multipart completion 7e106fd9612 mon: Add command "nvme-gw listeners" 6bad4c47b7b mgr/dasboard : Fixes navigation e2e test fixes : https://tracker.ceph.com/issues/73832 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 4468c4ef004 cmake: skip boost dependency on ALIAS executable targets bdae7b3ff7b monitoring: Fixes for development f9c986aabf6 doc: Harmonize hyphens to underscores in rados/troubleshooting/troubleshooting-mon.rst c88f305a927 rgw: always return crypt headers on put obj 8ceb9b515e3 rgw: expose copy_source from rgw_s3_prepare_decrypt 77b86722300 rgw: fix lifecycle transition of encrypted multipart objects a5f45165a6d rgw: set compression attrs in copy_obj_data() fdb78c7fb07 rgw: implement CopyObject for encrypted object e6a74d83cf8 rgw: introduce RGWCopyObjDPF for RGWCopyObj 81145b1a129 rgw: introduce DataProcessorFilter b813b17ba4c rgw: pass DataProcessorFactory to copy_object a3cc500a543 mon: ceph pg repeer should propose a correctly sized pg temp. 95d3bc70d1d rgw/sal: introduce DataProcessorFactory 2e63108ca45 rgw: gather all get_decrypt_filter together 1c9e3560d59 rgw: teach rgw_s3_prepare_decrypt about source decrypt headers bfa58a63543 rgw: involve next on RGWGetObj_BlockDecrypt::flush b415ecee4f2 rgw: involve next on RGWGetObj_BlockDecrypt::fixup_range 89005c0f29c mgr/dashboard: rgw accounts form group mode disable option is not working 807b32edd17 qa/suites: exclude ceph-osd-crimson a639ca75be5 qa/crontab/teuthology-crontab: use default flavor for crimson b891223a0f3 debian,ceph.spec: add ceph-osd-crimson as dependency e194cca29c4 qa/tasks/ceph.py: introduce crimson_compat 08c334bcb7d ceph.spec.in: Include Crimson by default in RPM builds 750c25b082c mgr/dashboard: add API endpoint to add images to consistency groups bd18dec8ec0 monitoring: remove cephfs.libsonnet mention from dashboards.libsonnet da976a57205 doc/releases: add cephadm notes e3d019d515d doc/releases: change final release date 110869777b8 doc/releases/tentacle: add missing rgw deprecation notice 3254a5f8793 doc/releases/tentacle: fix Crimson highlight 4c78fc91fa5 doc/releases/tentacle: add Crimson highlight dde7f34ef50 doc/releases: arrange sections in alphabetical order 7f06d00dca8 doc/releases/tentacle.rst: more RBD items 8fbbe028519 doc/releases/tentacle.rst: fix seastore typo ab3b182d341 doc/releases: remove extra word fcb7cadd5e3 doc/releases/tentacle.rst: Update Crimson section e197d288779 doc/releases: remove note that is not specific to tentacle 536d7ddd1d4 doc/releases: move smb support update into highlights c6429414b6a doc/releases: give smb update a better category title 41c4232a245 doc/releases: add Crimson section and clean up references b8987156ad8 doc/releases: edit formatting and other small changes 4f16f105e73 doc/releases: add one more item to RADOS 7419fbb512e doc/releases: add to CephFS section 4bf50c81491 doc/releases: add more to RBD section 7c5c55e9284 doc/releases: clean up RGW formatting 45675f70bbf doc/releases: take quincy out of timeline since it is EOL 6cb65f92967 doc/releases: add more to mgr section and fix rados formatting 62c08145ce2 doc: improve rados section for tentacle release notes 245e5479057 doc/tentacle: add more RGW release notes 87573d3be98 doc: add Tentacle v20.2.0 release notes e61450cc42b qa: Add a new test to test-erasure-code-plugins.sh to test for new health warn 00927fd24f9 mon: Add a new health warning for blaum-roth erasure code profiles with a w+1 that is not prime 7c5ecc1c040 qa/clusters/crimson: increase reactors in fixed-1 cluster 3cda4c7bde1 mgr/cephadm: don't remove TLS certs if svc still has daemons on host 3e107ec67e3 test/lazy-omap-stats: overload get_output() to accept both lvalue and rvalue refs f1e02159b03 qs/standalone/scrub: modify osd-scrub-snaps.sh to match ceph-objectstore-tool changes 55efded0a95 mgr/dashboard: carbonize smb service custom_dns input 27a32bfc278 script/ptl-tool: organize options and improve help output dd741e70926 script/ptl-tool: add options to set distros/flavors/archs 430a9aad553 test/ceph_assert.cc: Disable core files a350a5bdf01 ptl-tool: add options to append to branch name 6547fe483fa doc: Added release dates to reef 18.2.5 to 18.2.7 and squid 19.2.0 to 19.2.3 inclusive. 84d4206c2df qa/suites: exclude ceph-osd-classic 9ef4391acd7 mgr/balancer: optimize log code 40ceb20b267 mgr/balancer: optimized info level logs 8969e9cf7a4 mgr/balancer: changed logs to debug level d4969e18310 mgr/dashboard: Remove illegible texts from the dashboard 90c148593d0 mgr/dashboard: add footer to side-panel 70c4c79d979 client: Only used known fields when comparing policies e61455d7e48 test: Add set fscrypt policy test initialized padding 8c79bd94998 mgr/dashboard: rgw users link user with account e2e failure 3b959f364fe test/rgw/notify: cover case with motre than 1K topics 1cbca1dbdce rgw: Remove invalid Content-Type header RGW OIDC discovery requests 2d602e617b6 vstart: all rgw debug logs must honor the -d flag b984980897d rgw/notify: fix reading the entries in a loop 1de46f335ea cephfs: make sure mon authenticate before objecter start 8cce3277edc tests: add a test case for cephfs SingletonClient d29084085ba mgr/dashboard: Set max subsystem count to 512 rather than 4096 495f9b74965 mgr/dashboard: Carbonize multisite sync policy forms 5cb507606d5 qa/suites/crimson-rados-experimental: cleanp thrash 93ec29e3d20 qa/suites/crimson-rados/thrash: cleanup seastore workloads 08345ffb17b qa/suites/crimson-rados/thrash: enable seastore dac591543da container/Containerfile: fix crimson package naming c9cf2e74b81 Improve efficiency of OSDMap::check_pg_upmaps on large clusters. Don't copy large weight_map objects. 20623d64cdb Ensure scrub is doing a deep-scrub before attempting to check the consistency of erasure coded pools 07684321562 Fix for "data digests are inconsistent" 5c4a48e4a04 Add Devika Babrekar into githubmap, organizationmap, mailmap c562dc8e698 qa: Remove cephadm e2e tests from teuthology 05b125b2387 mgr/smb: Disable posix locking in share definition c8e878fe5f5 mgr/cephadm: Fix RGW zone endpoint auto-update log ic in _update_rgw_endpoints method 445075c509a src/test: test async i/o after cluster is full 256eb4cd27a rgw/logging: do not create empty temporary objects fc7d90b3bdb src/test: async i/o test cases 8d725df3931 src/test: add some helper functions to avoid cumbersomeness f6da1d1a524 rgw: fix boost::intrusive::list iterator handling for erase 32453d25c5d qa/workunits: add Rocky Linux support to librados tests 75becf22af4 qa/standalone: osd-scrub-dump.sh: test large object scrubs 167e60bd9b5 osd/scrub: increasing the default data-read stride 4e0abfb0706 qa/tasks/ceph_objectstore_tool: Use crimson-objectstore-tool ceb3272fdae debian/rules: enable WITH_CRIMSON when pkg.ceph.crimson profile is set f504bb50ceb qa: install ceph-osd-classic and ceph-osd-crimson a37b5b5bde8 debian,ceph.spec: split ceph-osd into shared base and implementation packages 7a2654679e0 ceph-volume: drop legacy python2 support from configuration.py acf17cef645 ceph-volume: remove exc_info from ceph.conf load warning f5b2e2454ad ceph-volume: migrate namedtuple based config and sysInfo to dataclasses c275c4eca2b mgr/dashboard: add API endpoint to create consistency groups a56ae5b0e6d mgr/dashboard: start node virtual-env after starting ceph cluster 42c75ff73f7 mgr/dashboard: add API endpoint to list consistency groups 3d76fb36974 doc/cephfs: fix doc for config option pause_cloning ab378291bc3 doc/cephfs: fix doc for pause_purging config option 25680021ee2 debian: Use system packages for cephadm bundled dependencies f670dce5d0b cephadm/tests: Add tests for deb bundled dependencies 3ff9b0c24e3 cephadm/build: Add Debian package support for bundled dependencies 2c68c1496db cephadm: fix zip_root_entries population in version command 2fadd341046 cephadm/tests: fix _dist_info function logic error 01c9cbadb02 include/rados/librados.h: fix documented rados_cluster_fsid return value b46ecc1d4f2 rgw/posix: Account for incomplete uploads during deletes 998e4299af4 rgw: update keystone repo stable branch to 2024.2 0d2870e7403 crimson/seastore: adapt _mkfs() to new coroutine::experimental::generator a5e89414381 src/msg/Policy: explicitly include <map> for std::map usage 8a7ce72fb5f seastar: bump up seastar submodule 53c2197115f qa/suites: remove centos restriction from valgrind yaml c59f5afa7b3 mgr/dashboard: allow deletion of non-default zone and zonegroup b533de73e10 mgr/dashboard: fix Physical Disks identify test race condition 4c1fb7bf7b6 mgr/dashboard: resolve the redirect url with the prop name 1be7446ada2 mgr/dashboard: Carbonize - Multisite Zone 7f53521561d common: ModeCollector: missing bits b187ff0fb54 librbd: add rbd_aio_write_with_crc32c API for precomputed checksums 71c9f546ce1 rgw_file: restore ability of attributes to be...restored 88ac9187bce qa/suites/rbd/valgrind: don't hardcode os_type in memcheck.yaml 3efcdbf92fb common: ModeCollector: locating the value of the mode 5cc3d7c3053 qa: Use the pythonic way to install CBT python requirements 9cccb68f5b9 osd/scrub: scanning the rollbacks not mandating a reschedule 494fb20f509 rgw/logging: deleteting the object holding the temp object name on cleanup 81a6d6072b7 rgw/posix: Fix race condition in Inotify causing segfault af7870f0a24 initializing of enable_progress length_before_processing length_post_processing on construction. these variable are getting initialized on s3select/CSV flow, no valgrind local run had discovered any issue related to these variables. valgrind reports produced by teuthology points on run_s3select_on_csv to contain UninitCondition warning. sometimes. a94b339df38 qa/suites/crimson-rados/perf: use fixed-1 and ignorelist 6ee90df0035 mgr/dashboard : Fixed warning icon colour issue with carbon colour fixes : https://tracker.ceph.com/issues/73769 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> c3ee87cff64 mds: session reclaim could miss blocklisting an old session d6ba31e8006 mgr/dashboard : Remove subalerts details for multiple subalerts fixes : https://tracker.ceph.com/issues/73766 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> ce50009bc72 qa/suites/crimson-rados-experimental: Test recovery thrash test 93445b75f96 qa/suites/crimson-rados: rename thrash_simple to thrash_seastore_simple 3d5d8872d66 qa/suites/crimson-rados: run simple_thrash only with seastore 9018618b095 qa/tasks/admin_socket: fix ceph-ci/main usage 94ceaeecfb6 qa/suites/crimson-rados/obejctstore_tool: disable rbm 8e794cf16f7 qa/objectstore/crimson/seastore: add 2q cache type fadb471d521 qa/suites/crimson-rados: restructure objectstore dir 27e24a19d8f qa/suites/crimson-rados: update clusters dir ee5c6fdfa43 doc/rbd/rbd-config-ref: add clone settings section 83c3e2a84b3 src/common: Fix formatting in options/rgw.yaml.in 3e47e09c128 qa/tasks/cephadm: add support for distro-suffix ea060de8481 mgr/dashboard : fix - about model tooltip issue fixes : https://tracker.ceph.com/issues/73753 Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com> 3e0877476e0 crimson/os/seastore/epm: avoid unnecessary container copies 17b8bbd5ff5 qa/tasks: make the cephadm and vstart_runner tasks aware of watchdog f5ed57afc9c test/librbd: Remove crimson skip from TestDeepCopy 965e6f910ec test/librbd: Reenable tests for Migration b32194a215d crimson/osd: fix assertion fail in prepare_clone 5aa5b03932c bluestore/BlueFS: fix bytes_written_slow counter with aio_write ff70af99748 rgw/keystone: perf counter for cache hit wrong f6da8d71b29 mgr/dashboard: fix upgrade's cluster alerts popover 326fb6107be client: fix dump_mds_requests to valid json format 9a459ebc98c crimson: Move send_to_osd call outside with_obc lambda e5499f52a9b common/perf_counters: don't use magics for add_u64_counter{,_histogram} 6ec36b470a0 doc: Add fscrypt documentation 4885a48fcf1 cephfs: Only build client with fscrypt on linux cf6bd410f4c python-common/ceph: Fix lint and various python errors 7e2f9eb03b8 client: Do not check file size during trim read be99ab3e33d test/client: When testing large io, consider fscrypt ae65b1b3e35 client: Use nearest fscrypt block when clamping max io size 72e7040f7f8 qa: Do not use ec_profile with fscrypt dummy cb9c7177e1c client: Do not expose ceph_fscrypt_key_identifier in api cefaafd1ce3 qa: Grant ALL caps fscrypt integration tests 0ad0a52f632 mds: When setting fscrypt attrs ensure client has ALL caps 590cfe86468 client: During fscrypt get policy do not display inbuf ee9096686e4 client: clean up warnings in client 12967a06121 client: clean up warnings in fscrypt b25a678035d qa: Add fscrypt dummy encryption to fs workloads 757164a0ea2 test: Add test for fscrypt dummy encryption 4465cd87949 client: Add fscrypt dummy encryption e5d8bf81811 test: Clean up after fscrypt unit tests e711a6ca003 libcephfs: ll_set_fscrypt_policy_v2 - use in->dirstat 53e88865d6e client: ll_set_fscrypt_policy_v2 separate "directory empty" logic 27ad41755ca test/pybind/cephfs: add tests for fcopyfile() b1846d50eaa client: in fcopyfile(), update len to read only leftover fragment 45fdea0304f test: Test unsupported fscrypt policy f1a7c762e18 client: Check for supported fscrypt policy 91a547398b0 qa/cephfs: Add test case for enctag too long 70944fda000 mgr/volumes: Enforce enctag max size 7892665ca16 qa: Add interop testing between fscrypt fuse and kclient 4512c5bc1c4 client: make FSCryptDecryptedInodes std::shared_ptr 9cbdc10386a libcephfs: Include libcephfs.h def for ceph_get_fscrypt_key_status cfe3dab721f doc/cephfs, qa/cephfs: Reword some documentation. dee913c1e6b client: During fscrypt write skip unneeded reads e73a7cc21cf qa/tasks/vstart_runner.py: remove write_file from LocalRemote 4a3363e68d0 client: Address misc comments 4b7aa10e5fd client: turn is_encrypted into helper 519f31271e4 client: skip fscrypt decrypt_bl if data bl is empty. 1d09c234927 client: Match functionality of nonblocking_read_sync read_sync 4c8f944ccf1 client: During fscrypt rmw (write) use correct read type 70e239e4b7c client: During fscrypt set policy check null dentries 6b2fc75c3bb client: During fscrypt set policy bail if policy exists 95c5765b5aa client, libcephfs: Expose fscrypt apis as low level 24fa0be2c9a client: Breakout fscrypt get policy into method e46ac0a0b1d client: Rework fscrypt set policy to match fscrypt specification f9fb36db8c2 client: Fix logic in fscrypt hole optimization 6cf17e76b0b Address misc comments 8c1ff7d93a5 client: Cache client_fscrypt_as config value a70d399013e client, test: Remove FS_IOC_GETFLAGS and STATX_ATTR_ENCRYPTED b35b341c16d client: Skip fscrypt_last_block if in non-fscrypt mode a322f53ecb4 client: Implement cloning fscrypt subvolume snaps 80b585cb24b client, libcephfs: Add fcopyfile bindings 516f2d1ab30 pybind/mgr/volumes/fs: Prepare mgr to clone fscrypt snaps 5227488ae6f qa: Add tests for fscrypt subvolume dcd571a6556 client: Allow for reading raw written data. fb7b8be36dd fuse client: map ENOKEY return value to itself 73a8b2fda19 client: do not fscrypt encrypt snapshot names 367fc7ef1fe client: Simplify getting decrypted fname dcaa002f5bd client: Rework vxattr_cb_fscrypt_file_set to assign properly aea4990d3cf client: provide fscrypt vxattrs in CapSnap 414a68ae996 client: Only run complete in read_modify_write if finish provided 7fea0297ad8 client: correctly account for Client::WriteEncMgr() ref counts 90925d26791 client: remove unneeded goto jump 93f29299b33 test: clean up some warnings 08cc0e64546 qa: Add fscrypt unit tests to workunits aa5989e68c7 client: Add additional case for fscrypt enabled setattr 511212a75ff client: Check for dname max len before wrapping name fb3ad9988e1 client: Add fscrypt enc support to C_Read_Sync_NonBlocking cf275b3adbc client: Address misc comments Mar 24 8fb269cb859 Fix Testclient bug 2354e1fb4bb client: Add shared_mutex edb1445d818 client: When creating WriteEncMgr take into account client_oc 87d79b64638 client: Add client_fscrypt_as option d7a9fe20bbb client: simplify some filepath constructions 44e0890c43b client: print readable encrypted names 54f5bc6c12a client: do not wrap ceph special names 37a501dfc71 client: remove remaining fscrypt conflicts 23c38d17042 client: use path walk and on-the-fly enc/dec for fscrypt bf76f37507d client: Use correct sizes in write_success 19ea835340e client: Use PATH_MAX for max size of fscrypt enabled symlinks 1a92b8131ef cephfs/test_volumes: Create tests for enctag bb1445766ae doc: Add documentation for enctag in subvolume e0c4040aa15 client: Add is_encrypted libcephfs api 81102450ec5 mgr/volumes: Add enctag to subvol 8b3bcef6cdb client: Use new errno identifiers 62fd57c34fc client: use fscrypt headers provided by linux bca998429d2 client: Fix up a few things in read_sync path 16d544f42d6 client: Calculate len before prepare_data_read ccdbc482760 client: During fscrypt write, ensure we get Fr cap e30da6070b4 test/libcephfs: Add skips to tests where mount root is a subdir 2e601a1d782 client: Use enc_name when linking a fscrypt enabled inode f17b4049c1d client: Do not encrypt '.' or '..' e5769e130ff client: Use symlink_plain for decrypted fscrypt name 1ebf764acb6 client: fscrypt last block bd85319c89a client: Do not decrypt bl on trim read f703d1d4c44 client: set symlink dest to proper value 111faef1e5a test: Add function policy populator for reuse in fscrypt tests. 1d097e74539 client: change conditional to check for is locked. 208c1e5d672 fuse client, fscrypt, test: Implement and create tests for S_ENCRYPTED in inode i_flags 28a8ebef572 client: Use correct sizes on write_success d1dbf638dc3 client: clear logical size on open(O_TRUNC) 5e693cbd9bd test, client: implement tests for not supported FALLOC ops, use policy to determine the padding size for encrypted filename 5938362bbd4 client: Add fscrypt last block 196f6107794 client: Ensure file_cache cap is released. 3feeb2723af client: Various fixes to fix multi-fuse client 06ccadda049 qa: Convert and create tests for libcephfs fscrypt f297f1adb31 client: Update fscrypt_file when mds info is newer a7aa6491c3c qa: Add tests of interopability of fscrypt between fuse/kernel d208442eb95 ObjectCacher: handle nullptr hole case faa86c8568f ObjectCacher: On RetryRead, ensure "hole" value is used b640e05bbcc client: When calling update_inode_file_size, provide correct size cbbbe695893 client: Use effective_size in eof read cdcbe93dc2b client/FSCrypt: securely erase crypto key fb26978ebe2 client: Implement status for fscrypt key status 2f2730b2e56 client: Add busy case on key removal 44796d6ac2d fuse: enable ioctl on dir for fscrypt acb6d4dbd49 src/test/libcephfs: add test cases for fscrypt key removal busy case 367fa0043b5 qa: Added workunits for testing problem snippets on rmw workloads 12091a56450 qa: Allow fscrypt testing on fuse c790b86bbe2 client: fix non-encrypted case in read_sync 658d97704c9 client: fscrypt rmw fails when endoff end of block or file Fscrypt rmw fails when end of a write lines up with end of a block or end of the file. 123c473d214 client: During lookup of fscrypt symlink, use target fscrypt info. e04f31d77b3 client: Fix logic in need read start/end to account for fscrypt. 601a5c9ca4f client: After a rebase, no lock is necessary. 470d1becd56 Client: fix O_TRUNC issue 92b3a8a2cee client: Ensure symlink plaintext is set 78dc86cdfef client: rmw doesn't get_cap_ref like it should. After rmw, it put_cap_ref and it didn't happen. Issue with bool need_read. 40d6d80fc0b Populate add key return f91d3d3fb51 test: Add test for semantics 3630ed64492 client: On fscrypt enabled directories, only allow read/write to files in dir when unlocked. Client should not be able to read/write the encrypted payload. 70008de1871 fscrypt: Add tests for add key, remove key, set policy. a49852cd3a6 client: Allow setpolicy only on dir and when it is empty. e92d5a60335 Add multi user support on a unlock claim. e425cc3a68e client,test,osdc: add beginnings of fscrypt support 9eeb71e2852 rgw: fix `radosgw-admin object unlink ...` e43b6b7a25b .github/workflow: Disable cron based github actions on forks 16d46aed673 monitoring: use ceph_cephadm_daemon_status in ceph-nvmeof 2a5c73f1e8a mgr/dashboard: Carbonize Administration module > Create Realm/Zone group/Zone cd6fab28706 mgr/dashboard: fix cephadm e2e failure f213d84b947 mgr/dashboard: fix oauth2-service creation UI error 20f4bc92020 install-deps: remove old logic for unsupported centos/rhel 8 99e02980341 install-deps: warn about gcc older than 13 for el9 and later 85e0081a002 tools: handle get-attr as read-only ops in ceph_objectstore_tool 5e2d2b56eaf rgw/cloud-restore: Read size once restore is completed 0059d5b9bed rgw/restore: Add notifications for restore events 14d10414414 src/common/options/global.yaml.in: Fix BlueStore capitalization bf75e8b7863 Revert "Merge pull request #65940 from Tom-Sollers/fixing_blaum_roth_for_ec_profiles" 075f5afd4a7 doc/radosgw: Fix frontends.rst typo a3cba037212 rgw: Fix virtual-hosted style URL 7bca6467c78 rgw/cloud-transition: Include LocationConstraint for non-default regions 20743ee6896 rgw/frontend: fix typo in function name 1f86c9b1e74 mgr/volumes: remove unnecessary log error lines from earmark handling c32027ba919 doc: Update the old ceph.com/community/ links to ceph.io/en/news/blog/ 85ab08a7351 doc: detailed explanation of set_choose_tries 4195243a4a5 doc/cephadm/services: Clarify service discovery auth in monitoring.rst 7795b1c665b zstd: update submodule to v1.5.6 4cc10e7aa8b compressor/zstd: modernize ZSTD API usage in ZstdCompressor d74678e0a86 cmake: fix checks for WITH_SYSTEM_QATLIB 636a3929c1a rbd-mirror: allow incomplete demote snapshot to sync after rbd-mirror daemon restart cf44913720c rgw/logging: make sure source bucket is in the target's list f92765ee0fb rgw/logging: removed unused APIs from header 3dbe81e8001 mgr/dashboard: bump validator package to address vulnerability b4d61dcd304 mgr/dashboard: fix icon alignment in navigation header fb6dbbf11b7 mgr/cephadm: update grafana conf for disconnected environment fe9dcf47b74 mgr/dashboard: fixes for quick-bootstrap script bc4ad1f1ec4 mgr/dashboard: fix missing checkbox icon in table fb409aab5a8 mgr/dashboard: generic redirect link for a table item 0d628a76c8e rgw: treat -EFBIG as advance-and-retry in unordered listing 5f7fc5267e5 mgr/alerts: enforce ssl context to SMTP_SSL ea3dada0e00 mgr/dashboard: fix cephadm e2e dependency graph failure ffc03740669 rgw/d4n: Add config option for local RGW address 7951de1209d doc/foundation: Update associate member representative 7ae7ef376b5 Containerfile: Support rocky/el10 in repo URLs 2ccaa2f5515 cmake: update C standard from C99 to C11 f19754d0424 mgr/dashboard: add text-label-list component 4a6752964c7 Add Abhishek Desai into githubmap, organizationmap, mailmap Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> 82b299cf05f smb: Update the configuration logic for smbd ports a65c46c2495 doc: Pin pip to <25.3 for RTD as a workaround for pybind d24c3ac173c doc/start: Improve hardware-recommendations.rst 1085dfca361 src/rgw_bucket.cc: include restore stats in the same json dict for bucket stats 103eb69f06c doc/radosgw: deprecate STS Lite for tentacle 8760b50b76c mgr/dashboard: Maintain sentence case consistency in side nav bar titles b72071af0be mgr/dashboard: Edit user via UI throwing multiple server errors c8c03ac4e38 container/build.sh: add 'rocky-10' suffix if necessary b9447c552d1 test/libcephfs: Fixed path buffer overflow 2484fdc8daf Add .clang-format configuration file b9f81a682db mgr/cephadm: add tombstones to persist certs info after mgr failover d06d06fda84 mgr/cephadm: fix objects_by_names initialization + some improvements 9b43590e12e rgw: fix checksum for get part request 871740fef44 mgr/dashboard : Carbonize -> Report an issue modal fixes : https://tracker.ceph.com/issues/73192 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> ee864798373 client: signal waitfor_commit waiters for write delegation enabled inode bc9310345a1 mgr/dashboard: remove hardcoded strings in About component 74a74b1d5c2 RGW - Standalone - Enable building without librados f9f8fca1e49 os/bluestore: Add fast-path optimization in Blob::put() by checking nref == 1 bfc6bafb954 mgr/dashboard: fix misaligned text links on login page 9b606ad8968 mgr/dashboard: Fix timestamps in APIs b47880f82de tasks/cbt_performance: Tolerate exceptions during performance data updates 6b0d6f2ba0a doc/dev: update suite example with latest os 1371e1a2208 doc/dev: fix suite sample layout example 256e27764ae qa: Add a new test to test-erasure-code-plugins.sh to test for new health warn b9aca15605a mon: Add a new health warning for blaum-roth erasure code profiles with a w+1 that is not prime ad4e36d12f0 vstart: -d also raises --debug-rgw-lifecycle 889ce8b9800 rgw/lc: raise default rgw_lc_max_wp_worker to 128 31f6e601f8b rgw/lc: pass optional_yield to LCObjsLister d1f31bcb3da rgw/lc: replace WorkPool with ceph::async::spawn_throttle bd20e7bd1de rgw/asio: add scope guard warn_about_blocking_in_scope 1976d67ce23 rgw/lc: remove WorkQ* args 2a3f1174b8f rgw/lc: pass optional_yield arguments to WorkQ functions 0fa436b3360 supports lc aio using coroutines ccd20243e4d nvmeof: refactor timer for exact frequency timing with drift correction c4168074508 qa/workunits/rbd: moving mirror_image_snapshot to wait_for_replay_complete 79c53cd98f1 doc/rgw: use --bucket instead of --uid 6eb0dae941a messages: fix MOSDOpReplay decode of old version bad_replay_version a10b77144a2 include/types: Update set wire function parameter 79e0f1a685f messages: MOSDOpReply encode and decode errorcode32_t with PGID64 features on db44419d094 doc/rgw: fix the description error of --max-read-ops 0d57f42ee53 rados/osd: enable compact_running perfcounter at PRIO=5 802195ec97f cmake: add cmake 4 support 2dd3057ea31 script/build-with-container: optionally source WITH_CRIMSON from env file 25efee4ba3d script/build-with-container: add more detailed variants 46a34facf29 doc/rados: Fix and improve formatting in operations/monitoring.rst fd19a09e02b install-deps.sh: install proper compiler version on Debian/Ubuntu adde7a57e9c common: use constexpr buffer size instead of fixed 256 for read_format in cputrace 5c700ed7d64 mgr/cephadm: renames ceph_device to ceph_device_lvm afdc76e4a97 doc/radosgw: Small fixes in config-ref.rst 75ad3164802 rgw: Update buffer size for HMAC signature and improve signature max size calculation 70e931c8be7 cls/hello: debug_cls -> debug_objclass in the comment d8a3f3e2c5a rgw: asio/beast add ssl hot-reload 187573e9e7d qa: implement qa tests for admin account REST APIs This commit implements tests related to setting account quotas at the account and bucket levels for qa and Teuthology tracker: https://tracker.ceph.com/issues/72527 Signed-off-by: Nicholas Liu <nliu204@bloomberg.net> 8e80e00412d doc/radosgw/adminops.rst: edit account documentation This commit addresses PR comments related to the doc/radosgw/adminops documentation 78c55d62a80 doc/radosgw/adminops.rst: add account documentation This commit adds documentation on how to create, get, modify, and delete accounts using Admin APIs. It also explains how to set quota for an account and how to create a user under an account 60e3de22ade test/rgw: refactor test_rgw_admin_meta This commit refactors the test_rgw_admin_meta test by using common helper functions e45368e97a3 rgw: implement set account quota for admin REST APIs This commit implements the functionality of setting bucket- and account-level quotas with PUT /admin/account fe884aec531 mgr/dashboard: fix multisite wizard realm configuration mode a5eafa6848e doc: Introduce Crimson User Guide 59bc0a0b3e9 mgr/dashboard: fix generic form submit validator for inline edit 9d92dbb2cb4 cmake: BuildArrow.cmake uses bundled thrift if system version < 0.17 dd868a9e535 cmake: Findthrift.cmake parses version string 0c209b8ae4c doc: Update governance.rst to have member names sorted e17fb642b55 mgr/cephadm: add the VIP to the internal mgmt-gateway cert SAN list cfb985d4f3d mgr/cephadm: Increase the default expiration time for NVMEoF subsystem cache 9210c7f228a doc/rados/operations: remove duplicate word 929b47f8388 debian/control: Add libxsimd-dev build dependency for vendored Arrow 2defde30e4c cmake/BuildArrow: Use AUTO mode for xsimd dependency detection 25621b231a6 mgr/dashboard: file/smb: Create SMB share dialog is missing a share name input 7e3d493dc32 rgw/multisite: check the local bucket's versioning status when replicating deletion from remote dadfa93bfac rgw/lc: Do not delete DM if its at end of pagination list. c89163904dc doc/cephfs/createfs: Recommend default data pool on SSDs for non-EC 87b5a12c547 qa: fix device name in workunits/nvmeof/fio_test.sh 82d06637b50 qa: add 'refresh' config to cephadm.wait_for_service 39eabe53050 monitoring: Fixes for smb overview a123ad1cc04 tools/kvstore_tool: reduce BlueStore.h exposure. e7317a836a7 cephadm/build: Fix _has_python_pip() function check d67a7131ad8 rgw/restore: increase read_thorugh restore period 04d8e67d4a0 script/build-with-container: add build image variants f798d6a48a5 Dockerfile.build: make FOR_MAKE_CHECK a build argument b1b0defd449 install-deps.sh: let FOR_MAKE_CHECK variable take precedence 2b057ec7bb4 test: Add statfs test case for mixed quotas dd02ea9b185 client: account for mixed quotas in statfs 3174b4ee9a9 monitoring: Fix Filesystem grafana dashboard units 89f2e1f809c mds: Refactor cache dump path formatting and improve config lifetime handling 058f55c366d mds: Avoid use of moved 'fs' in FSMap::commit_filesystem and FSMap::decode 8b7366f2562 mds: Use default implementations for copy constructor and assignment operator in MDSCapMatch and MDSCapAuth 1586765b6d3 mds: Refactor Mantle::balance to use std::string instead of std::string_view for script parameter b709713e4bf mds: use after move ack error in QuiesceAgent::agent_thread_main 8d1033ee089 mds: Remove unnecessary std::move on const expression in MetricsHandler::handle_payload 4a6fe285eb8 mds: Simplify logging messages and ensure consistent use of std::move in quiesce_cluster_update and quiesce_dispatch c5763efa3ad mds: operator=() should return 'CDentry&' 9609410db0d osd: Make scrub determine the correct object size. 90910884dc6 doc/mgr: Fix a copy-paste error in smb.rst 3fa4457ca9c doc/cephfs: Fix Sphinx warnings and other minor improvements ffa1c113acc mgr/volumes: make clone state transition to fail when UUID dir is missing... 87a39a0afac mgr/volumes: allow --force to delete snapshots even when UUID dir is missing 1ed9eaba073 mgr/volumes: allow --force to delete subvols even when UUID is missing 78f62f4207b rgw/logging: fix race condition when name update returns ECANCELED 58461e03c88 rgw/dedup: add throttling mechanism add274c113e mgr/cephadm: Limit the value of max-namespaces-per-subsystem. 381aaa4e3c8 docs: add package on macos to run ceph-backport.sh 5ee0bbf3689 doc/health-checks: update MON_NETSPLIT documentation abfa5a36773 qa/suites/rados: white list + add MON_NETSPLIT tests df1105c1a8b msg/async: ProtocolV2::send_server_ident update ProtocolV2::global_seq d0f3e9b259b .github/workflows: update qa-symlink to use pull_request_target dcf27b9eee1 script/verify-qa: print commit on run da40484b957 qa/tasks/workunit: fix no module named 'pipes' 805eb2f7d4e pybind/cephfs: fix including of platform_errno.h b5b8104efc8 doc/mgr/dashboard: add note that only RSA keys are supported for TLS a0da67cb7f0 mgr/dashboard: replace bootstrap badges with carbon tags 01cb6886bef mgr/dashboard : Fix secure-monitoring-stack creds issue Fixes : https://tracker.ceph.com/issues/73379 c5ed7ce8288 crimson/seastore: use DMA alignment for block size instead of stat 8c6e14f651f doc: fix syntax for removing zone from zonegroup 4d72fe53f25 qa/d4n: Fix redis scanning in workunit 97f54b08153 mgr/dashboard: change the default max namespace from 4096 to None in subsystem add command to take gw default ab30d60998b doc: Update os-recommendations.rst to remove empty rows f96e92ae0f0 rgw/beast: disable keepalive for responses before 100 Continue dfc379ccf31 rgw/services: don't expose RGWServices::notify 3b7b7dae9b7 rgw/services: don't allocate RGWSI_Notify unless its used 137d2094a45 rgw: remove unused RGWSI_Finisher 732a9375f9e rgw: RGWSI_Notify drains the finisher before deleting RGWWatchers 4aa6ed886be rgw: RGWSI_Notify uses Finisher instead of RGWSI_Finisher c44ad21b1f6 mgr/cephadm: bump monitoring stack versions d5800b94782 cloud restore : add None type for cloud-s3-glacier 02c925c4c1a rgw/cloud-restore: admin CLI for restore list and status 088e746173f mgr/dashboard: Remove unused css 831cfdcd8fd mgr/dashboard: Fix color issue of notification panel 0c1d26244e3 mgr/dashboard: support templates in table component title 60140b1ccc8 mgr/dashboard : Fixed usage bar for secondary site in rbd mirroing fixes : https://tracker.ceph.com/issues/73447 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> f6d2b20dbb7 ceph-volume: lvm.Lvm.setup_metadata_devices refactor 3e8ec7d08ac osd/scrub: do not reduce min chunk on preemption 7ced3abd895 mgr/dashboard: support custom validator messages in inline edit a2f2696398c mgr/cephadm: configurable per-service stop timeout bae81a5c12b osd/scrub: new/modified perf counters for scrub preemption eba3b2ae543 mgr/dashboard: added node-exporter dashboard 72f3ad9549e script/build-with-container: improve error handling for invalid distros a13fa091dd6 script/build-with-container: add debian 13 (trixie) 7c40f7bd07a script/build-with-container: add ubuntu 20.04 (focal) 76fe5ad298e script/build-with-container: add a pair of fedora distro versions 4430a5ad6be script/build-with-container: lightly organize the distro kind aliases ac11a80a63a script/build-with-container: be consistent with naming in distro kinds 0419a1a1753 mgr/dashboard: ns list now support not passing nqn param d987989acc2 mgr/dashboard: fix dashboard freeze on missing smb permissions 780bb7fb2f9 mds,include: compare optmetadata fields to figure out inode divergence abadd70a717 mds,include: compare fscrypt fields too for inode divergence d0c9dcaea92 src/pybind/mgr/cephadm: Improve text in module.py 6e67f09ab40 mgr/cephadm: Add stick table and haproxy peers in haproxy.cfg for NFS to support nfs active-active cluster 7c67feb4db3 mgr/cephadm: add tcp mode for ingress over RGW 6d0b1374be5 mgr/cephadm: change balance in haproxy cfg to roundrobin in tcp mode 88866336759 osd/scrub: fix blocked scrub accounting a984ad83e7d rgw/dedup: Grant dedup process full RGW permissions. This is necessary to allow for the creation of intermediate SLAB objects on systems configured with Ceph authentication. df4ef781f6a rgw: add metric when send message with kafka and ampq 0ffbf3be8fa mgr/dashboard: support gw get_stats and listener info 7aac42984c7 mgr/dashboard: Rename side-nav panel items c29d6fff40b mon/Elector.cc: prevent assertion failure when receiving pings from removed monitors e7cafc2af58 src/mon/Elector.cc: Improve logging for the elector 595a111c8b5 src/mon/ConnectionTracker.cc: && HealthMonitor.cc Improve logging b297babca37 src/mon/HealthMonitor: Add mon_netsplit_grace_period to suppress transient MON_NETSPLIT warnings e5b9e3479d6 src/msg/async: Improve logging and prefixes for global_seq 5529b984a10 qa/suites/rados: increase debug && msgr-failures/none && white list 9b510912c1f qa/tasks/mon_thrash: enhanced logging in thrash f31caa1d045 ProtocolV2.cc: Add more loggings to functions that needs them 1bd8e0c7ab2 msg/async/ProtocolV2: Speed up connection logic when peer restarts 59835a2b75c docs: Fixed typo e391bb0fdbb src/test/fs: add more --copy-dt-needed-entries d6f023850c7 make-debs.sh: use ID instead of NAME for workdir 34b497c2f36 src/script: add bookworm to build-with-container.py 13209e5a2a1 rgw: update cmake files to refer to system Apach Arrow version 9 8267213930d doc/dev : cputrace documentation addition d30b1e77836 common: common: cputrace global anchor IDs and unique per-thread assignment 2491a6c6077 common: cputrace refactor results to measurement_t 44b7f008914 common: cputrace HW_ctx was not cleared after use and perf counters were not stopped 6e05fe91086 common: add simple cputrace API, refactor HW_ctx, remove arena logging 00ae111f694 common: add cputrace_print_to_stringstream() and make WITH_CPUTRACE configurable 905d2a0714e common: add admin socket control and CMake flag for cputrace efc8b483664 common: Added cputrace tool for scope-based CPU performance tracing 887fd7402f8 doc/cephfs: Add missing labels in cache-configuration.rst 6a5d72100dd doc/cephfs: Typos and small improvements in scrub.rst dfa23483aa2 rbd-mirror: add cluster fsid to remote meta cache key 47565e9033d Dockerfile.build: Make sccache repo configurable 415fb348a2e os: eliminate get_omap_keys method acddf308ce4 rgw: bump up versions of Apache Arrow and utf8proc submodules 470f5e856ca cmake/rgw: WITH_RADOSGW_POSIX depends on WITH_RADOSGW_DBSTORE b7b8567dcc9 osd: Fix stats mismatch cluster error seen during scrubbing e4d515d3004 pybind/mgr/pg_autoscaler: Introduce dynamic threshold to improve scaling sensitivity 166abb66774 doc: Fix a Sphinx warning&error and use labels for links in 4 files 3157a593287 docs/dev: Add design document with information on proposed design for pool migration 33359fa5513 qa/cephfs: return only None in _run_umount_lf() 2ab8933c177 qa/cephfs: don't return defined variable c31990d8912 ceph-dencoder: add `SnapRealmInfoNew` in ceph-dencoder types 53b71ca1857 snap_types: fix encode/decode for the newly added fiels in SnapRealmInfoNew ed231f75d49 test/libcephfs: add test cases for Client::mksnap and Client::rmsnap 350c377070d mgr/volumes: disable client_respect_subvolume_snapshot_visibility in CephfsConnectionPool::connect f70ee9ec4c4 doc/cephfs/fs-volumes: add documentation for controlling snapshot visibility 9ccfe0fba65 qa/tasks/cephfs: add test cases for subvolume config snapshot_visibility 3850c8d28e4 pybind/mgr/volumes: add getter and setter APIs for snapdir_visibility 5f9eb71c2a7 client: check client config and snaprealm flag before snapdir lookup 6520c6d7708 common,mds: transmit SNAPDIR_VISIBILITY flag via SnapRealmInfoNew 7fb744f74af mds: rebuild snaprealm cache if last_modified or change_attr changed b8550999691 mds: add ceph.dir.subvolume.snaps.visible vxattr d15280be9f1 mon: Avoid false stuck peering warning ec2923adde4 crimson/rgw: Fix clang compiler warnings. 93e34a7cb58 mgr/dashboard: type the rbd mirror modes 46167e7b694 mgr/cephadm: Cephadm support for NFS-Ganesha TLS configuration 6afc034df42 mgr/cephadm: Adding support for custom CA cert 839360365b7 osd: Relax missing entry assert for partial writes. b0868c094cb doc/cephadm/services: Improve formatting and small fixes in index.rst 157499476f2 test/crimson/os/seastore: fix runtime error in rbm 1e441f238c6 crimson/os/seastore/rbm: swith rbm_device to coroutine 3994e3ae3fa crimson/os/seastore/rbm: switch block_rb_manager to coroutine 24ad40673be crimson/os/seastore/rbm: switch the print functionality to use LOG_PREFIX 07f814ed5d8 crimson/os/seastore: switch writev() in nvme_block_device to coroutine dd7c7741393 crimson/os/seastore/rbm: switch nvme_block_device to coroutine 8e27c32f0b4 include/cephfs: improve a critical comment c13ba9e36de mgr/telemetry: add 'ec_optimizations' flag to 'basic_pool_flags' collection 1fba459071d rgw: fix 'bucket rm --bypass-gc' for copied objects 2439bcb8739 pybind: convert ceph errno to host-based errno 2ca88381cc5 src/include: move ceph_to_hostos_errno() to separate header file c9b23363673 qa: set -x for qa/workunits/libcephfs/test.sh 89435685274 rgw: fix test_awssdkv4_sig.sh helper env var 6af92515f05 rgw: drop unused keysel attrs for non testing encryptions f3dac1a91cd rgw: send one x-vault-token on vault requests 910bc9ed3d9 rgw: expect vault returns key detail on key creation 1480cacaaeb Added blank line after header block e376f67e2f5 Update indent settings remainder 4adaf64d718 Add blank line after header block 85d82faac25 Update indent settings h 3eac91cec63 Update CodingStyle to specify use of spaces c8c1019d196 Add missing blank line after comment block f1bac41828d Update indent settings cc 8a9b6f84515 Dockerfile.build: improve docker compatibility e0fa55cef88 qa/tasks: move smb related task funcs out of cephadm.py to smb.py 804274e5b9e debian: package rgw-policy-check in ceph-common c38a9138ba8 src/common: add helper to prepend "..." to trimmed paths 10e4ccb104d mds/ScrubStack: avoid generating inode path since it is unused e4c301b9f02 mds: fix few log entries bdc8aae400f client: trim path before logging it 11de1e5772f mds: log trimmed path wherever generating full path is necessary 26d9f3c0c5d doc: changed the jenkins job URL for build cee5f26293a RGW - Posix Test - initialize "existed" bools 30f82992a2a qa/tasks: remove templating functions from vip.py 0b61b1c1ff6 qa/tasks: update python.py to use template module f87e6222657 qa/tasks: remove generic template stuff from cephadm.py 7c6407cbe02 qa/tasks: replace vip.exec with template.exec b45fe1b7600 qa/tasks: replace cephadm.exec with template.exec 550ce35be90 qa/tasks: add template.py for generic templating needs e97d81144a1 qa/suites: do not use cephadm.exec when it is not needed e8ede11d04f qa/suites: do not use vip.exec when it is not needed 2acfd2407d5 docs: EC Direct Reads design ea7aa27452f ceph-volume: use udev data instead of LVM subprocess in get_devices() 6c0992e1bdc debian: include rgw-gap-list manpage in ceph-common 674d42d9023 Fix usage log issues caused by incorrect form of name-by-user keys 1. The old name-by-user keys start with user/payer IDs. If those IDs start with '0', the resulting name-by-user keys could fall within the range of name-by-time keys, which has the prefix of '0' followed by 11 digits of the epoch. The intermingle of name-by-user and name-by-time keys causes the usage function to mistakenly treat name-by-user usage logs as name-by-time logs. This leads issues like failure to trim old logs because some name-by-user logs with later epoch listed BEFORE name-by-time logs with earlier epoch, causing the trim logic to stop prematurally. 2. To fix the above issue, adding prefix '~' in name-by-user keys when the user/payer IDs starting with '0'. 3. Introduce a rgw config option to indicate the need to deal with the co-existence of old and new name-by-user keys. Since handling both keys incurs performance penalty, this option helps avoid it once the cluster no longer has the old keys. 4. usage_iterate_range() is splitted to usage_iterate_range_by_user() and usage_iterate_range_by_time() as only the former needs to deal with the potential co-existence of old and new name-by-user keys. This split intends to simplify the logic. 5. "usage_basic" test in test_cls_rgw.cc is adapted slightly to reproduce the issue mentioned above. 6. A new test case "usage_key_transition" is added to test the handling of the co-existence of old and new keys. b1d819e0ed4 rgw/sts : get-caller-identity fix#72982 ccedaa6adb7 doc: Fix typo in src/common/options/global.yaml.in 523c8adf951 mailmap: update affiliation for Kefu Chai ead4e64e871 crimson/os/seastore/epm: assert main_cleaner in get_segments_info 0a0be79605f crimson/os/seastore/epm: Skip open_for_write check with unittests 86a26804320 mgr/dashboard: upgrade carbon components package@5.59.2 6754d7a28fb monitoring: Standardize Ceph Grafana dashboards naming convention 7b71919a44e mgr/dashboard: fix the separation between CLI and API only commands 3ff7d737bb1 mgr/dashboard: raise exception if both size and rbd_image_size are being passed in ns add 201b020f206 crimson/osd: always ask for the newest osdmap 4429c7b875f rgw/s3: Always include x-amz-content-sha256 header in AWS v4 signatures for S3 compatibility a9d718331c7 rgw/datalog: Remove use of 'detached' in `rgw_log_backing` watch e936cab4617 scripts: add script to fix GH workflows 6cceb6c30ca .github: pin GH Actions to SHA-1 commit 2e8c7384146 osd: hash function for eversion_t 6c7b0dd629e os: resolve unused variable warning 4f0f3961fb7 common/compat: resolve signedness warnings 792222ca440 common/compat: resolve unused label warnings 02d18b30449 crimson/os/seastore: extend mkfs/mount errorators to enospc 826dc6548f8 crimson/os/seastore/epm: Verify available segments on mkfs/mount bb6d9585c42 crimson/os/seastore/async_cleaner: Introduce get_segments_info f82ab1cbf24 mgr, mon, osdc: pass complex parameters by rvalue reference 995cbd714b6 crimson/os/seastore/epm: open_for_write() into coroutines ce9ca7264c8 crimson/os/seastore/epm: BackgroundProcess::mount() refactor 32bf97c706a Revert "crimson/os/seastore/segment_manager: Check segments prior to mkfs" be0c40c89c0 test/libcephfs: add test for fsync on a write delegated inode d7eca69a5b8 client: adjust `Fb` cap ref count check during synchronous fsync() 1336e393134 rgw/d4n: refactor unused conf gw_d4n_l1_datacache_size bf25307b6ae crimson: admin: fix FTBFS with gcc 15 bee24dec441 monitoring: fix MTU Mismatch alert rule and expr aed373399a6 mgr/dashboard: fix duplicated editing of cell 29563b25656 crimson: fix building without systemd a9fdbb79264 qa/suites/crimson-rados/thrash_simple: enable osd down 78aaffb64cd test/crimson/seastore/test_seastore: add the clone_range UT case 484344d8d6e crimson/os/seastore: support OP_CLONERANGE2 77a6edfd77a crimson/os/seastore/lba_manager: allow cloning part of the mapping 86107a4af03 crimson/os/seastore: do "copy_on_write" if the to-be-modified object needs it 039314efbb4 crimson/osd/osd_meta: change osd_superblock to be a head object e29927358c5 crimson/os/seastore/object_data_handler: we don't have to maintain the symmetric indirect lba relationship at the time of clone b8a9b77506e crimson/os/seastore/onode: add the interface for swapping onode layouts 07b740728e1 crimson/os/seastore/onode: add the "need_cow" field to indicate whether the onode's object data space needs to do clone before modification 30872b2ae74 mgr/dashboard: fix command alias help message 8258d270437 pybind/mgr: add default set of cmake/ctest labels to tests 94f42b648fe osdc: Objecter::linger_by_cookie() for safe cast from uint64 2455a713d44 librados: linger callbacks hold a reference to LingerOp 1430cd67d8f mds: for logging generate only 10 final components of dentry path 1518690210f mds: for logging generate only 10 final components of inode path 2cd6c97c617 osd: Remove monc reference from scheduler 773a8005b31 qa: ignore cluster warning (evicting unresponsive ...) with tasks/mgr-osd-full 9ed7f931c68 prometheus: Add Cephadm orch ps output metric to prometheus 2a64e0d674e mgr/dashboard : Carbonises Notification body Fixes: https://tracker.ceph.com/issue/71734 Signed-off-by: Anikait Sehwag <anikaitsehwag.amg@gmail.com> ed00c818e7e doc: added a note for damaged hard links in scrub documentation 13eb6c6ce9e qa: add a test to verify that a damage hard link id detected during scrub a83787b5a85 mds: identify damaged hard links during scrub 4cf55bdb9e5 mgr/cephadm: Fixed stats frontend to always enable health url da5d3ab0f32 mgr/cephadm: Allow Ingress service to expose the metrics via HTTPS also add fields in spec to accept monitor ips/ monitor networks 14b1dd781de mgr/cephadm: Adding genric cert/key name support for get certificates adfb0233c56 RGW - Fix dedup build 786f28cbb7d mgr/cephadm: Remove Grafana self-signed certificate migration logic 9e051711550 mgr/cephadm: Remove SSL RGW migration logic 521e2a9039c mgr/cephadm: Fix RGW spec validation for deprecated rgw cert field a53f397770d mgr/cephadm: Include mgmt-gateway/oauth2-proxy in upgrade process d789764e7cb mgr/smb: fix error handling for fundamental resource parsing bef59f17293 Check if `HTTP_X_AMZ_COPY_SOURCE` header is empty 551ff3dbd44 mgr/dashboard: add nsid param to ns list command c4c4c4a7dac Implement further review feedback for CopyFrom changes to ceph_test_rados_io_sequence 102eaa833d2 rgw/lc: LCOpAction_CurrentExpiration checks mtime for delete markers e2b43be0f9f rgw/lc: enforce consistent rgw_lc_debug_interval start times 40354f83d7b .github/workflows/pr-checklist.yml: Update 280d8f66bf8 mgr/dashboard : Hide suppressed alert on landing page fixes : https://tracker.ceph.com/issues/72944 a01909e7588 mgr/dashboard: Blank entry for Storage Capacity in dashboard under Cluster > Expand Cluster > Review fcca31eeadf rgw/bucket-logging: fix typos 6439fe4ecd1 qa: suppress OpenSSL valgrind leaks 151ed79bb3d pybind/mgr/mirroring: modifies the cli command type to read 2d0e71c8456 mgr/dashboard: Local storage class creation via dashboard doesn't handle creation of pool. cfecf7c867d mds/FSMap: fix join_fscid being incorrectly reset for active MDS during filesystem removal 6231955b5d0 pybind/mgr: pin cheroot version in requirements-required.txt 0f98740fd06 rgw/restore: Fixing teuthology restore tests 1eb0623d6b7 rgw/restore: Mark the restore entry status as `None` first time 90b962cae2e qa/rgw: Include rgw_restore_processor_period in s3tests 71882f61d5b rgw/restore: Persistently store the restore state for cloud-s3 tier 0c0e0d436e6 mgr/dashboard: fix prometheus API error when not configured 35323380403 cephadm: support custom distros by falling back to ID_LIKE cd0a94e7449 crimson/os/seastore/async_cleaner: add should_block_io_on_clean comment 33172a1be63 crimson/osd/pg: create "submit_lock" unlocker before locking it 50ef955207e mgr/dashboard: FS - Attach Command showing undefined for MountData 580bf32f4c7 fix unreachable code path 42923ebc4e9 doc: fix osd min size 398f7a0c067 blk/kernel: bring "bdev_async_discard" config parameter back. 937ac626afd rgw/lc: At least wait for |rgw_lc_lock_max_time| while trying to fetch the lc-shard lock to get or update the bucket status. 541d13a6305 rgw/lc: if the buckets last lc processing time is less than start time of current LC session, then continue processing bucket for lC even if the status is not in initalized state. 3ab70dd3e11 common/Formatter: move {JSON,Table,XML}Formatter to separate files c8372be8800 rgw/iam: add NotEquals UT 225241d6ae6 rgw/iam: fix NotEquals conditions to use AND logic instead of OR c4e750e6767 rgw/iam: rename condition helpers for clarity deaff8cb5d6 rgw/multisite: empty realm_id and period_id passed into do_period_pull() was causing remote zone to respond with 404 error during a period pull. df935c4065b mgr/dashboard: support inline edit for datatable 135f3adb497 mgr/dashboard: fix zone update API forcing STANDARD storage class 68debbfcdd5 qa/osd-scrub-snaps.sh: remove non-existent "clear-snapset head" operation for obj12 7911624fde1 ceph-objectstore-tool: Documentation and Validators for clear-snapset 4f9a926a467 cephfs-journal-tool:: Don't reset the journal trim position 7e85556318a qa: Validate cephfs-journal-tool reset trim 64e7e3a4b9a RGW - POSIXDriver - Cleanup vstart 0f8d0969d50 RGW | fix conditional MultiWrite 6c448c2710b crimson/os/seastore/epm: add retried_blocked_io metrics 2c2dee27470 crimson/os/seastore/epm: reserve_projected_usage into coroutines 14412e76a2f doc: add format option in docs 9ce943e2155 mgr/dashboard: fix SMB custom DNS button and linked_to_cluster col 1de607bda03 osd/SnapMapper: Clarify key formats 9dda7afd8d8 osd/SnapMapper: fix SnapMapper::Scrubber pg shard parsing 1d60c755cf9 build(deps): bump vite in /src/pybind/mgr/dashboard/frontend ef7effaa33b options/mon: disable availability tracking by default 596b494c6ea script/redmine-upkeep: do not try to update status if open subtasks exist 25577cd3b0e rgw/lc: initialize variables passed to sscanf() c2ff991d50f test/.../test_cbjournal: destroy CircularBoundedJournal instance prior to reactor shutdown a58f1696afe crimson/.../circular_bounded_journal: inline do_submit_record into submit_record be127e17e96 crimson/.../circular_bounded_journal: add journal submission metrics d168a5a0c78 crimson/.../circular_bounded_journal: convert do_submit_record to coroutine ea06e530e74 crimson/.../circular_bounded_journal: convert submit_record to coroutine ee36a4eb3e2 crimson/.../transaction_manager: convert do_submit_transaction to coroutine 0fb6c523391 crimson/.../extent_placement_manager: convert BackgroundProcess::run() to coroutine d3d3d79f400 cephadm: add command to send signals to daemons ea624e471cd qa: add test for subvolume rm with retained snapshots when cluster is full ba199cf4c18 mgr/vol: fix subvolume removal with retained snapshots when osd is full 6d1552dc6de qa: Add nvmeof:upgrade suite 51fb4b6abe9 mds: add ceph.dir.subvolume get vxattr 70e0dd39edb json_spirit: Enhance string processing to handle empty and single-character strings 2299dc04c28 btree: Safeguard delete_leaf_node to prevent dereferencing null nodes 058b0fb0940 os: Improve custom delete operator for raw_combined to ensure proper memory cleanup b02d2f3d9ec rgw/s3select: Disable stringop truncation warning for s3select.h f5ea624c0c5 osdc: Update CB_ObjectOperation_decodevals and CB_ObjectOperation_decodekeys to persist temp val 8b088d41d75 mgr/dashboard: Allow FQDN in Connect Cluster form -> Cluster API URL 1efd37d4b5f mgr/dashboard: fix rbd form mirroring toggle 53a6856d603 monitoring/ceph_mixin: fix Cluster - Advanced OSD grafana panel 3b2c9840427 mds: remove unused enum values for subvolume metrics ebca859c5d2 ceph-mixin: reset auto_count to 10 59d9e69b04e crimson/os/seastore/transaction_manager: read_pin_by_type read the whole extent if it's not fully loaded f97f1dc290c qa: Add CEPHADM_FAILED_DAEMON to nvmeof ignorelist 1d377a8986b qa: Remove multiple gateway conf from nvmeof thrasher 6592972da53 qa: add "osds down" to nvmeof:thrash ignorelist 09c90340c1c qa: allow overrides for nvmeof task 3ea140756e7 qa: Improve scalability test d19d3f52b1e doc: deprecate 'peer_add' command 611dce09f3e cephfs_mirror: deprecate 'peer_add' command 217b071329e mgr/cephadm: set a healthwarning for host SSH timeout 527b15d82e7 rgw/bucket-logging: minor code cleanup b97835c733b script/redmine-upkeep: include each issue changed in summary a4010a0f272 ceph-volume: fix UdevData initialisation from empty /run/udev/data/* file 23670b54e34 .github/workflows/pr-checklist.yml: Update e28a7747211 mgr/cephadm: fix migrations logging e1ac09ec912 rgw/multisite: reset RGW_ATTR_OBJ_REPLICATION_TRACE during object attr changes. 1624bc12298 .github/workflows/redmine-upkeep: use smaller limit for testing push d6130710764 mgr/cephadm: Change spec to ingress_spec 4195486c8ed rgw: implement timestamp-based epochs. bb14e76b3c4 mgr/cephadm: Add check for virtual_interface_networks 236c018aa2d .github/workflows/redmine-upkeep: remove concurrency limit f76f6a06749 qa/tasks/cephfs: raise exception if incorrect fstype found 753ccb4f1f2 crimson/.../store-bench: fix coll_refs index error afc28a6df37 mon/Monitor: forward-declare struct health_check_map_t 5f68e7b1030 mon/Elector: forward-declare class Context 5ccaa44292c mon/ElectionLogic: forward-declare class ConnectionTracker d6f26a9c203 mon/PaxosService: forward-declare class Paxos a472bd55b29 mon/Monitor: forward-declare class MonMap 757ab5fc22f mon/Monitor: forward-declare class Paxos 8a9b1cefe85 mon/FSCommands: forward-declare class Monitor d24ecb2adeb mon/MonCap: include cleanup de566549310 mon/MgrContext: move JSONCommand to separate header b8f220091ae mon/Monitor: forward-declare class MMonCommand fd53d9c5768 mon/MonmapMonitor: include cleanup 5cb3ef954af mon/MDSMonitor: include cleanup a6c031c3e1a mon/MDSMonitor: forward-declare class Monitor 6a93b59ff28 mon/Monitor: forward-declare class Messenger 688d2f4ff76 mon/PaxosService: forward-declare class Monitor 0327640d1b3 mon/CommandHandler: include cleanup 6ca7a19b7ad mon/MgrMap: un-inline methods to reduce compile times cbc7ecefac2 mon/PGMap: un-inline methods to reduce compile times 7cda67fdc46 mon/MgrMap: un-inline methods to reduce header dependencies c1cee8d7626 mon/mon_types: add missing include 4c0e4d457f8 mon: add missing includes 073584877f5 test: add missing includes 3db2b576705 mgr: remove health msgs from the metrics if osd destroyed dae572d5008 rgw: add rate limit for LIST & DELETE ops b9bf4bcfbb2 mgr/dashboard: fix total capacity value in dashboard 14716744267 doc/cephadm: Fix errors and small improvements in services/monitoring.rst 81b2d6c48e3 doc: github: add a note reminding to use one command per comment e7146361483 src/common/options: Improve global.yaml.in 71a1be4dd0a build-with-container: add argument groups to organize options aa97469a4c2 doc: fixing starting release of mgmt-gateway/oauth2-proxy services aa5b4eeb0cb src/cephadm/cephadmlib/daemons: Fix typos in ceph.py and Dashboard messages 7e3d4601550 python-common/tox.ini: enable black formatting 294f16c0ac7 python-common/fs: reformat earmarking.py with black fcd58065faf python-common: reformat utils.py with black 6ef9f6f5c09 python-common/cephadm: reformat images.py with black b2e44e6cf00 rgw/d4n: change cache write ::open() flags 2bc49226147 mon/OSDMonitor.cc: optionally display availability status in json 3b9632696a5 crimson/os/seastore/segment_manager: Check segments prior to mkfs 46b6632575d crimson/os/seastore: BlockSegmentManager::primary_mkfs coroutines c163fc020e3 common/options/crimson.yaml.in: add hot_tier_generations minimum 7ec88cc601f crimson/os/seastore/epm: Add logs and comments 99d463a7d73 crimson/tools/store_bench: update example, switch to --debug 2092ad0c2d8 crimson/os/seastore: Remove error on expected logic 5aade0e946f crimson/os/seastore: add logs around mkfs 0b13fdb3b7b crimson/os/seastore: SeaStore::mkfs() into coroutines d77caf39476 crimson/os/seastore: prepare_meta() into coroutines 7a50999ec09 crimson/os/seastore: test_mkfs() into coroutines aa7a586c569 mgr/dashboard:[NFS] add Subvolume Groups and Subvolumes in "Edit NFS Export" form ee37978e734 mgr/dashboard: add nsid param to ns add command 46b74faa763 mgr/dashboard: --no-group-append default value to False, aligned with old CLI 38f62c4a379 mgr/dashboard: fix None force param handling in ns add_host so it won't raise exceptions f3f1cc51563 doc: update data availability release notes 393f8715358 qa/rgw: add test for cross-zonegroup copy obj 8295e3bf123 rgw: report copy obj progress from the frontend CR 09230d9b483 common: remove unused attribute 625e3abaf0c rgw/create_bucket: for swift:create_bucket(), should stop creating new bucket_instance_id object and bucket_index shard objects in rados and just update the bucket_instance_info db9dd7c6ef2 osd/PrimaryLogPG: avoid redundant container clones and lookups 7cbcaf4ede3 crush/mapper: Mark 'pushed' variable as maybe unused to suppress compiler warnings a4ee4ba0ca1 Implement review feedback and remove unused variables from ceph_test_rados_io_sequence adb448b4f4e mds: fix rank 0 marked damaged if stopping fails after Elid flush and log trimmed 7f8e1ae0d8c log: add missing includes f6021bd4829 mgr/dashboard: Migrate from promtail to grafana alloy 72cebf0126b mgr/dashboard: fix missing schedule interval in rbd API 12bbd8b00a7 doc: Enhance the ceph df and ceph osd commands c703b701343 script/redmine-upkeep: reset merge state after PR change f1b487ccebe qa: Run fewer RGW jobs at higher priority every week 14ca16576d1 mgr/dashboard: add multiple ceph users deletion 263f13f27da rgw/logging: add error message when log_record fails 300e5058a5e mgr/dashboard: fix data mismatch in Advance section in Tiering. 42ce56f4b96 mgr/dashboard : Skip calls until secure_monitoring_stack is enabled fixes : https://tracker.ceph.com/issues/72635 6021dda7ed1 qa, test: run unit tests for cephfs.pyx with non-root user 05082a93298 test/pybind: add unit tests for rmtree() in cephfs python bindings f9046ca052d pybind/cephfs, mgr/volumes: refactor purge() to be non-recursive 918dff407d9 mgr/dashboard: Form retains old data when switching from edit to create mode a3136ab7ae0 osd/scrub: rename authoritative_set to 'all_chunk_objects' 428af22d790 osd/scrub: assure mostly read-only access to ScrubMap objects d5bfcdb7588 osd/scrub: modify repair_object() to accept a single auth peer 5eda016780b mgr/dashboard: improve search and pagination behavior 66ce55ae2bc mgr/dashboard: show loader while changing pages fe3d6417bfa qa/cephfs: fix test_subvolume_group_charmap_inheritance test e6a21442ab8 doc: update documentation 1327fc8897c test: add subvolume metrics sanity test 13d9baf38ea qa/cephfs: run selective test classes from basic volumes test 17c35a97ac0 qa/cephfs: use fuse mount for volumes/subvolume tests bbc141e8dcb mds, messages: include subvolume metric count in log dumps and message exchanges 4d2ad699fb5 mds: remove unneeded SubvolumeMetric field from `struct Metric` d2360189a08 mds: add metric debug log in refresh_subvolume_metrics_for_rank() 1a733b01489 mgr,stats: integrate subvolume metrics a49ba9d27ab mds: aggregate and expose subvolume metrics c376635d5d5 client,mds: add support for subvolume level metrics 60a7f72bb16 rgw/logging: rollover objects when conf changes b8fe4870104 monitoring: add user-agent headers to the urllib 8458a19abf8 cpp-btree: fix array bounds warning in btree_node::swap() 69263e74445 qa/tasks: Ignore expected `backfill_toofull` warning aa3bb8addda mgr/dashboard: Tiering form - Placement Target in Advanced Section 0ab2a4e266e mgr/dashboard: Carbonised Toast Notification Used carbon toast component to carbonise toast notifications 8c25005bb07 rgw/notifications: sharded bucket notifications 674bd44001d libcephfs_proxy: fix userperm pointer decoding for older protocols b5df01a605d libcephfs_proxy: remove unnecessary protocol references in daemon 8cd9f8c808a libcephfs_proxy: remove unnecessary protocol references in client 62e91714849 libcephfs_proxy: fix protocol structures for backward compatibility cdd74a35103 mgr/dashboard: Group similar alerts fixes : https://tracker.ceph.com/issues/72788 e5d4e5b97a0 doc: update RGW HTTPS configuration to use certmgr and new fields 776063737d6 mgr/prometheus: Handle empty/invalid JSON from orch get-security-config 55c3eb2f2e3 test/osd: Extend ceph_test_rados_io_sequence to support copy operations e2fe5f17198 test/libcephfs: validate asynchronous write and fsync executing concurrently 325420838ca client: catch buggy reference count drop for MetaRequest 7ab995b7159 client: synthetically delay write operation f29c63e20bd client: log unsafe operation count (for debugging) c88a21c30d8 libcephfs/client: asynchronous fsync interface 70880723eaa various: update pip+https URLs to new form. 16ab79dacbf rgw: fix policy enforcement for GetObjectAttributes 4507cd1d70c mgr/cephadm/nvmeof: Add fields for prometheus frequency to NVMEOF spec file. 3a94a7b2ed0 rgw: Record the `service_unique_id`, if present, in the SrviceMap 9c0a09131f5 doc: wq!Update dashboard Pending release notes 546d5231478 doc/rados/operations: add kernel client procedure to read balancer documentation e003be839b0 mgr/progress: expose API from CLI 62fed994693 rgw/logging: allow committing empty objects 7c76a657e4a test: repeer_on_down_acting_member_coming_back is continuously failing 025827b4b56 client: some improvements for Client.cc 705d54b1c2c rpm: Migrate license in ceph.spec to SPDX eea6525c031 rgw/logging: fixes data loss during rollover 1654b8f0bdf test: add replica pool support to ceph_test_rados_io_sequence e8ef0f441c2 common: Added values to json::OSDPoolGetReply aaa19869273 osd/scrub: clear m_ec_digest_map between objects 2b57f435a1d workunits/rados: remove cache tier test b184df73d0e mgr/cepahdm: fixing nvmeof scraping Prometheus config generation c8dea4b9ad0 doc/cephadm: updating certmgr docs to reflects new changes 930280141e1 mgr/cephadm: Adding RGW migration for the new certmgr certs format ade502d0632 mgr/cephadm: removing call to previous method to storing all certs e93dd30cc18 mgr/cephadm: fixing nvmeof section in cert_mgr UT + new UT d80d9885e70 mgr/cepahdm: adapting UT after all the changes f34cc110df6 mgr/cephadm: using 5 years for service-discovery internal certs bffb1782f2f mgr/cephadm: adding self-signed certifiactes support for nvmeof svc faccf7984e1 mgr/cepahdm: adapting node-proxy service to use the new cert mgmt 52c640cee91 mgr/cepahdm: adapting agent service to use the new cert mgmt 02fa7b3b050 mgr/cepahdm: adapting node-exporter service to use the new cert mgmt e0e7d68e7e7 mgr/cepahdm: adapting Prometheus service to use the new cert mgmt bf0e24c49aa mgr/cepahdm: adapting alertmanager service to use the new cert mgmt 4f03347296f mgr/cepahdm: adapting oauth2-proxy service to use the new cert mgmt fa2b084b6d1 mgr/cepahdm: adapting Grafana service to use the new cert mgmt 1961d65aad5 mgr/cephadm: adapting mgmt-gateway service to use the new cert mgmt c3da5077989 mgr/cephadm: adapting iscsi service to use the new cert mgmt 96d3e1ed95f mgr/cephadm: adapting ingress svc to use the new cert mgmt approach 284ad001449 mgr/cephadm: adding automated certificates mgmt for cephadmservice 626a82d98f4 mgr/cepahdm: adding new filtring options and certificate ref checks c5e12623cc8 mgr/cephadm: adding support to prevent editing readonly certs 757ba4b62de mgr/cephadm: adding enahanced support for self-signed certs 21da8f3bad8 mgr/cepahdm: add support for custom duration when generating certs 34ce724bd3e mgr/cepahdm: adding support to extract ips and fqdns from cert 1db347a6463 mgr/cephadm: adapting python-common UT to the spec changes 6dcb6690776 mgr/cephadm: adding new spec generic fields fo ssl/certifiactes 2c70de2114b cephadm: pass wal/db slot count to ceph-volume 6b85e4d453f osd/scrub: reinstate one-warning-per-chunk behaviour 5e59c521f8d osd/scrub: modify OMAP stats collection b3d0d73c587 qa/{asan,lsan}.supp: suppress Python module and libstdc++ false positives 9e06dc260b7 crimson/.../circular_bounded_journal: remove apparently obsolete references to applied_to ffaf4f03bd6 crimson/.../transaction_manager: convert submit_transaction to coroutine a4edc9db2dc crimson/.../seastore: simplify do_transaction_no_callbacks 12680f87712 crimson/.../mclock_scheduler: add crimson specific background job c1cc2f108fd dmclock/src/dmclock_server: template type of cleaning_job 2b8b5a576e5 dmclock/src/dmclock_server: no need for PriorityQueueBase::cleaning_job to be a unique_ptr faa6c0fcd7a dmclock/src/dmclock_server: move PriorityQueueBase::finishing into PushPriorityQueue abea0967561 osd/.../mClockScheduler: remove MonClient argument 1f44f38359f common/mclock_common: don't use config keys to pass profile info to client_registry 212ac92168d rgw/multisite: update api_name during a zonegroup rename 22a87d959bc pybind/mgr/dashboard: Use teuthology's actual requirements e61bfe0d30a rgw/create_bucket: for s3:createbucket calls return immediately if bucket already exists without updating the metadata. 6dc322421f7 common: Allow PerfCounters to return a provided service ID 2b5efb757a8 doc: update Grafana certificate configuration to use certmgr c8980f467bd doc/rados/operations: Clarify overwrites in erasure-code.rst 8c47f85b825 mds/MDSTableServer: forward-declare MMDSTableRequest d711d68d235 mds/PurgeQueue: include cleanup c5c21b65058 mds/snap: include cleanup f4e58c2d8b9 mds/SnapServer: un-inline methods to reduce header dependencies 06c74cccca1 mds/SnapClient: un-inline encoding methods reduce header dependencies 38428875ff9 mds/MDSTableClient: include cleanup 52690e43bec mds/Migrator: un-inline methods to reduce compile times 0ef4dc9840e mds/SnapServer: include cleanup 8a87ea9affe mds/MDBalancer: include cleanup c67548481ec mds/MDSRank: un-inline methods to reduce header dependencies 8648e617fc5 mds/Mutation: forward-declare MClientRequest and MMDSPeerRequest 0efecdc6a70 mds/MDCache: un-inline methods to reduce header dependencies f8f581d8995 tools/cephfs/DataScan: add missing include 359f26ac125 global/signal_handler: add missing include e6ff8e9a226 crimson/osd/pg: tolerate NULL PG::pglog_based_recovery_op when cancelling pglog based recovery 60e95dbab87 inline_memory: optimize mem_is_zero for riscv using RISC-V Vector (RVV) intrinsics 45cebdad991 script: add script to help format QA review summaries 866f5ff63ab qa/tasks/thrashosds-health: fine tune ignorelist for degraded and undersized pgs c52e361fdd3 uadk: Build with ceph fork (for FORTIFY_SOURCE fix) 2f03a7f2036 rgw/rgw_public_access: include cleanup 09bf0aed913 rgw/rgw_tag: include cleanup d311a108026 rgw/rgw_xml: include cleanup 08c793f4bdf osdc/Journaler: un-inline the constructor to reduce header dependencies c553e62ff17 osdc/Filer: un-inline several methods to reduce header dependencies 63babbcc095 ceph-volume: support additional dmcrypt params 32eff35a639 crimson/os/seastore: SeaStore::write_fsid() into coroutines 7852c28481f crimson/os/seastore: SeaStore::umount() into coroutines 3da1bd4fb1c crimson/os/seastore: SeaStore::mount() into coroutines d4060fbac2a crimson/os/seastore: SeaStore::test_mount() into coroutines 8151476db2c crimson/os/seastore: SeaStore::stop() into coroutines 87ddf029eef crimson/os/seastore: SeaStore::test_start into coroutines c01ddbb0551 crimson/os/seastore: SeaStore::start() into coroutines 46df73f20f0 osd: Choose PDW over traditional RMW if number of reads required is equal b5cad269456 osd: Reduce the amount of status invalidations when rolling shards forwards during peering ac4e0926bba osd: Optimized EC incorrectly rolled backwards write 6365803275b osd: Clear zero_for_decode for shards where read failed on recovery b4ab3b1dcef osd: Reduce buffer-printing debug strings to debug level 30 da3ccdf4d03 osd: Fix segfault in EC debug string acca514f9a3 osd: Optimized EC backfill interval has wrong versions f3f45c2ef3e osd: Optimized EC choose_acting needs to use best primary shard cffd10f3cc8 osd: Do not sent PDWs if read count > k 2ab45a22397 osd: Fix decode for some extent cache reads. 2c2f1f83eca mgr/dashboard: fix RGW Bucket Notification Dashboard units 79166af192e build-with-container: ensure npm dir is set up before configure 23dc3697cfd rgw/account: bucket acls are not completely migrated once the user is migrated to an account b47393e09f0 os/bluestore: update some BlueFS perf counters more frequently fa94666f5fd os/bluestore: better reporting space usage in BlueFS 0b3e4a244a3 cephadm: fail the script if byte-compile step fails 48b4a7514eb test/neorados: Catch timeouts in Poll test 66bec97b0dc cmake: remove _FORTIFY_SOURCE define 7378581fd56 [Stretch Mode] mon: restrict changing mon election strategy post stretch mode 950249e4737 os/bluestore: dump meta ratio in bluefs perf dump. 772fbbbafcd rgw/admin: allow listing account's root users 1cbe41bde12 doc: add config option and usage docs e9e3d902109 mon/MgrStatMonitor: update availability score after configured interval 37173c8be11 mon/MgrStatMonitor: add pool_availability_update_interval config option b47bbf8afdf doc: add name mangling documentation for subvolume group creation ea2d8e9fc04 qa: add tests for name mangling in subvolume group creation f98990ac1bb pybind/mgr: add name mangling options to subvolume group creation 72d55eec85a osd: Optimized EC calculate_maxles_and_minlua needs to use ... exclude_nonprimary_shards 3c2161ee735 osd: Optimized EC choose_async_recovery_ec must use auth_shard 645cdf9f61e osd: Optimized EC don't try to trim past crt d19f3a3bcbb osd: Optimized EC missing call to apply_pwlc after updating pwlc d634f824f22 osd: Optimized EC don't apply pwlc for divergent writes 880a17e3962 osd: Optimized EC present_shards no longer needed bc3c9d12f0e osd/scrubber: Fixes issue with the number of missing shards being counted incorrectly e0e8117769a osd: Optimized EC proc_master_log fix roll-forward logic when shard is absent f1826fdbf13 osd: Refactor find_best_info and choose_acting 1b44fd9991f osd: EC Optimizations proc_master_log boundary case bug fixes b178ce476f4 osd: Invalidate stats during peering if we are rolling a shard forwards. f4b40422fef doc/cephfs: edit troubleshooting.rst 547d13f7f88 osd/scrub: avoid using moved-from auth_n_errs c618d444a09 mgr/dashboard: Carbonised Notification Header d6a45f8a13b qa/.../mclock-config.sh: remove tests validating config reset behavior c678a337314 osd/scheduler: drop OpScheduler::update_configuration 4b8ca5fd1ca common/mclock_common: move config registration and tracking into MclockConfig d4c89503b33 common/mclock_common: move profile defaults to header 5beee2ad46c os/bluestore: enforce extent split on shard boundary d6c61326a12 os/bluestore: Fix dirty_range in BlueStore::_do_remove 0f5e240e49a os/bluestore: Fix reshard on spanning blobs 9f84eb851d5 os/bluestore: enable dummy db/txc in ExtentMap::reshard_action. 718b103d872 test/bluestore_types: reproduce extent spanning over shard boundary. 798e379fba2 script/redmine-upkeep: fix formatting of comment f8a9e229deb os/bluestore: Refactor ExtentMap::reshard() into separate decision and action phases 9c76e209e25 mds: do "a != b" instead of "!(a == b)" when... 9bb79ca7564 mds: order in which fields are compared should in same order as... 07abf0a95e6 crimson/osd/pg_backend: tolerate enoent on head in rollback d4f90ea6d3c osd: stop scrub_purged_snaps() from ignoring osd_beacon_report_interval 975065d903a pybind/mgr/progrses: correct a typo in comment dcc44b0e98b pybind/mgr/progress: remove redundant pass statement 65ad90aebc5 mon: default chunk size change 3a192b7c38e mgr/dashboard : Fixed mirrored image usage info bar fixes : https://tracker.ceph.com/issues/72431 29174099ac4 nvmeofgw: fix issue of delete all gws from the pool/group when gws not removed from the map 1c14d3cd531 cmake/modules/Builduadk.cmake: fix build 1cd5aa4e030 cmake/modules/Builduadk.cmake: fix tabs/spaces 16183205fe1 make-debs.sh: Avoid OOM errors during build 1e121e5a3a9 mgr/dashboard : fix css for carbon input fields fixes : https://tracker.ceph.com/issues/72628 38b237c8cb1 mgr/dashboard:RGW- Storage Class ACL Mapping 100c20b7d65 osd/scrub: fix heap-buffer-overflow when checking digest emptiness b188d0768a2 mgr/dashboard: Update release notes and doc 5c3a8c426ab mgr/cephadm: After reapplying the osd spec, the OSD services are continuously applied in each serve loop iteration 7a04750a69d rgw/d4n: removing fmt related code as it is causing centos 9 build failure and is debug only code. dd06c75e3fe mgr/dashboard: add customizations to table-actions 94d414afb2b common/CommandTable.h: add missing includes c772ebfdc54 common/ceph_time: add missing include 9cac86ad00b crush/CrushWrapper: add missing include 5e9f4b5a4ad msg_types: add missing include 45bd76044f1 common/Finisher: add missing includes 74ed3cced98 mds/MDSMap: add missing include 61d1098f21f mds/SnapClient: add missing include b14d11d98bf rgw/rgw_bucket_encryption: add missing includes 4245c61e2e5 mds/mds_table_types: add missing includes 3e3c49ec3be include/util: add missing include d3c35864563 common/ceph_json: add missing include b257dddce0f common/ceph_strings: add missing includes 1307e4979c3 common/CDC: add missing includes c9f038a08a9 tools: add missing includes ddc7b1a5995 mon: add missing includes c5585550307 cls/journal/cls_journal: add missing include eea7719ea60 os/bluestore: add missing include fd25ad65277 librbd: add missing includes f67a7ecd908 client/Client: add missing include 5976db5cfd2 kv/RocksDBStore: add missing include 61ce038cbf6 mds/CInode: add missing include 32a7157d8cc common/LogClient: add missing include aac6b79e8cc common/Graylog: add missing include b6f50d5f89b osd: add missing includes ee60bfbec6d cls: add missing includes 3e31d6a34f9 mds/MDSRank: add missing include cfe3e60fab2 mds/Locker: add missing forward declaration 8266ad9b6a4 mds/Server: add missing include aec87cdb97e mds: add missing includes e16eedb87ce global/global_init: add missing includes 7115d6c53cf msg/compressor_registry: add missing includes 99cb01a6d59 msg/async/AsyncConnection: add missing includes e9cc8f74ff6 msg/Message: add missing include 99c41c0ba5e crimson: add missing include 228b3fbf425 messages/*: add missing includes d9a720e751d ceph_fuse: add missing includes e7e0786a03f ceph_{mon,osd}: add missing includes 530c2559303 ceph_osd: add missing includes f885a1248bb client/SyntheticClient: add missing includes 3aa88a99011 client/ClientSnapRealm: add missing includes 87f6df96887 tools/cephfs_mirror/PeerReplayer: add missing includes dd6bb4f6963 msg/async/ProtocolV2: add missing includes 07d35a53cb0 include/cephfs/types.h: add missing includes 31d1c86f946 test: add missing includes 099642cae27 include/types.h: add missing includes 8b087225c5f common/assert: add missing include f3c6cc60a0c journal: add missing includes ff21a038157 rgw: add missing includes a17349b87af mgr: add missing includes 83d723c959a auth: add missing includes ed4441eefc2 crimson/osd/osd_operations/client_request: rely on the checks in PG::do_recover_missing() to determine whether to recover clone objects 9860c7c544a fixing review comment 2bf2a9719fb .github/workflows: run redmine-upkeep for release branches c0721a39ed6 script/redmine-upkeep: filter by one status_id at a time 2ccd3609942 script/redmine-upkeep: add more statuses and organize 914ba8ab480 script/redmine-upkeep: break out of filters on limit threshold 07d4ca21a51 .github/workflows/redmine-upkeep: bump limit 164c1cf1cfc mgr/dashboard: Optimize css styles.css bundle b18bbeac724 mgr/dashboard: use border:0 for clipboard css c940c431e00 mgr/dashboard: Drop support for older version of dashboard a34bfe5af17 crimson/os/seastore/nvme_block_device: switch to coroutines in stat_device e0cf8cfdbd7 cephadm: Use specified method for osd.default 4ce1649001e test/osd: Suppress subobject-linkage warning in SelectMappingAndLayers class 3de82e38661 mgr/dashboard: minor fixes 11d160857f9 mgr/dashboard: Add localization for nx based production builds f4b09da1521 mgr/dashboard: expose image summary API 2713c34ea96 crimson/osd/recovery_backend: interrupt all recovery_waiter unconditionally when cleaning up the recovery backend 4edf9ef760d src/mds: Improve messages in MDCache.cc 5a288d488f8 src/osd: Improve message in OSD.cc ba5cb7b8d63 doc/rados/operations: Improve health-checks.rst 9a4a6cfe3fc rados/lttng: add lttng open *tp.so failed error message fixes:https://tracker.ceph.com/issues/72059 1496051af68 test/librbd: Add SKIP_IF_CRIMSON for failing tests ac296ce3577 fixing review comment ccd241da04c fixing review comment bfe5aac3f12 mgr/dashboard: Fix duplicate selection on multi-select in table component 95620cb1e3a cls/rbd: use brace initialization in cls_rbd_snap::generate_test_instances() f6387fd81c6 src: replace push_back(T{}) with emplace_back() 28c99a3f5fe rgw/d4n: comment to suppress false positive flagged by coverity 6c47dd9abca rgw/d4n: fix for rgw user create hanging when vstart cluster starts when there is data in cache. aa3bd25a7d9 rgw/d4n: changes to integrate pipelining with connection pool. 85c04af9de1 rgw/d4n: add pipelining to PUT in write-cache and read cache for data blocks directory entries f3d78c59883 rgw/d4n: use boost::generic::response for bucket list operation. 1ac08d30d19 the current connection setup is single and shared connection, the strand on that single connection may cause a serialization. it should be noted that per s3-request there are several redis-operation that may run on co-routine. the redis-connection pool implement the guarded acquire/release APIs. ad529cce49c Remove git clean -fdx ad8c68c0b26 mds/MDSMap: Enhance set_min_compat_client to validate iterator range before sorting feature bits ea4a52dd46a test: Refactor CORS configuration handling for S3 to improve clarity and efficiency 3109f6d50c5 mds/MDSDaemon: Safeguard lockup command to prevent undefined behavior with millisecs a9b6b34932a os: Page class: disable move operations and improve custom delete operator for proper memory management b4446f20a34 fixing review comment 8afcf9add14 .github: pass GITHUB_TOKEN to redmine-upkeep a772562c001 .github/workflows: remove unnecessary permissions for leaving PR comments 2800c8ddff4 script/redmine-upkeep: pass token to auth 72b34387946 script/redmine-upkeep: cleanup formatting for github comment 6c2e0377e79 crimson/.../cache: remove unused op_type_t::WRITE 67a97bc9cd5 crimson/.../cache: remove unused query_counters_t fae6dae7c92 crimson/.../cache: ensure cached extents are always aligned 064b53d4195 crimson/.../cached_extent: formatting nit b0261045640 crimson/.../cached_extent: method documentation nit 717668b06b0 crimson/.../transaction_manager: convert read_pin to coroutine 1b1b236072f crimson/.../store-bench: add random write workload 9c428bfd558 mgr/dashboard: Fix test_host.py test case fixes: https://tracker.ceph.com/issues/72717 6b07e75f622 test/bufferlist: verify vebuild_aligned_size_and_memory makes contiguous buferlist when explicitly requested. 3b4ea0f44c1 erasure-code: make bufferlist contiguous in ErasureCode::encode_prepare 2609d4f62e9 mgr/dashboard: Add /health/snapshot api 6c9a5536f34 mgr/dashboard: Dashboard nfs export editor rejects ipv6 addresses 8495d64e333 crimson/os/seastore/cache: clear extents_index when the booting is done c0ef358ef95 qa/tests: run full librbd test suite unconditionally b18de4b273a crimson/os/seastore/rbm: introduce get_end to remove error-prone code c8007c2a8c1 crimson/.../avlallocator: fix base_addr handling in find_block() f4854ad73cd crimson/os/seastore/object_data_handler: remove redundant indirect mappings at the end of ObjectDataHandler::clone() 41fe057c57a crimson/os/seastore/lba_manager: add the interface method to remove indirect mapping without touching the corresponding direct one 9100fd50c8b rgw: fix GetObject ETag with part number parameter 65bede20808 cmake: disable LeakSanitizer suppression output to fix CLI tests 46c540444dd make-debs.sh: invoke tar with --no-same-owner d1bd77e4c5e rgw/d4n: modified update method to optionally take a bool for dirty flag, such that when a flag is not set, then the method re-uses the old value of dirty flag using in-memory data structure. This is helpful in eliminating a call to directory to fetch the 'dirty' flag in the flush() method. 8e5de45da5a rgw/d4n: avoid reading head block (attrs) from cache, if they have already been read while reading permissions for an object. ad9d92f45ed rgw/d4n: reading from local cache first in iterate() method instead of checking directory first for existence of cache blocks. 55faac7af5e rgw/d4n: optimizing iterate method to align last block also with max_chunk_size(object size or rgw_max_chunk_size) and to perform checks based on object size. 996d5d3d4db crimson/os/seastore/transaction_manager: rewrite remove_mappings_in_range with coroutine 55af6643c9a doc/cephfs: edit troubleshooting.rst (Slow MDS) 3029cc9afde doc/dev:update blkin.rst doc for lttng trace fixes:https://tracker.ceph.com/issues/72059 192a2f30efd os/bluestore: track max latencies for key bluestore/bluefs perf counters 90ccfa02bd1 Update CephFS option descriptions and unit 32d97441faf doc: Improve PendingReleaseNotes 86d6e931bd1 make-debs.sh: make "skip debug packages" conditional 677c2c2f327 mgr/dashboard: catch more exception to show relevant cli output f83a3d93ddd mgr/dashboard: fix missing gw group error bd449f0ac82 mon/MonClient: post version request completions outside of monc_lock 1dbebbd86c4 mgr/dashboard : 72522 - Remove service instances column to imporve API perf fixes : https://tracker.ceph.com/issues/72522 cd2d91a6e78 mgr/dashboard : Optimized /host API to minimum resp fixes : https://tracker.ceph.com/issues/72608 cbdd07a7eec test/osd/scrub: fix test_scrubber_be following EC Scrub b.e. changes 4c61079e931 osd/scrub: calculate EC digest map size only once e915b396372 cephadm: add ubuntu 24.04 container build test for completeness 16530fde5e4 cephadm: enable test case for centos10 cephadm rpm build 26a499a8da3 cephadm: support cephadm rpm based builds without top_level.txt 32e98c484ac cephadm: add centos 10 container images for cephadm build tests 4d3e7b6bcb8 cephadm: remove centos 8 from the cephadm build suite containers 31c8010faa4 cephadm: fix some issues running existing cephadm build tests 9af3bc94fe3 crimson/.../store-bench: support dumping seastar metrics 4e9c0fa93fa crimson/.../store_bench: propagate results to main and output there f71f911fbcb crimson/.../store-bench: clean up results_t 9a46e39ec9c crimson/.../store-bench: minor cleanup in RGWIndexWorkload ff659b1771b crimson: factor out metric helpers from osd_admin d4eac2723c8 crimson/.../store-bench: refactor arguments and workloads 9aa5cec78bc crimson/tools/CMakeLists: store-bench to use lsan_suppressions c529429ab7d crimson/tools/store_bench: bump up blocked_reactor_notify_ms 5a155c916dd spdk: update spdk submodule to include fix for rocky10 linker error ae133173fda test/mds/TestQuiesceDb.cc: fix sequence point error for rocky 10 1aff7462fb0 erasure-code/consistency: Fixed signed-compare warning in ConsistencyChecker 35e6acf6606 crimson/osd: update snapmapper bits during pg splitting 24a0c2b9425 crimson/osd: add snapmapper for split PGs adb9b0718a2 crimson/osd/scrub: check if stats have been marked invalid 394b530b05c test_pg_splitting: add test for splitting with radosbench writes 769f5e1f4f9 crimson/osd/pg: discard ops in case of split 23397d32607 test/libcephfs: use more entries to reproduce snapdiff fragmentation issue. 0d45223dd71 doc/start: fix wording in swap tip ed6b7124613 src: Fix memory leaks in generate_test_instance() by returning values instead of pointers 552499f86b6 crimson/os/seastore: correct possible mergeable size for ool extents f5e160edde0 uadk: build with ceph fork (fix for __DATE__ usage) 978ab834c46 doc/rados/configuration: Mention show-with-defaults and ceph-conf 3fed58f43c3 rgw: discard olh_ attributes when copying object from a versioning-suspended bucket to a versioning-disabled bucket 916088a4e73 build-with-container: improve source rpm detection 544d8ab5eb8 make-srpm.sh: don't shell out redundantly to pwd fbe17bf4510 crimson/.../circular_journal_space: fix boundary check 621551af157 mgr/cephadm: Config parameter to set the max number of OSDs to upgrade in single iteration 84d2aad05fd common/async:: Update delete operator in CompletionImpl for improved memory management 887053c2228 mgr/dashboard: When the about panel is open, top-right options stay clickable, opening pages in the background 0c080993649 common/options/crimson.yaml.in: Move options to sections 5419f02ec91 common/options/crimson.yaml.in: Avoid "AlienStore" for user facing details 1262b82fd14 crimson/osd: Reduce no crimson_cpu_set usage to info addba1eb1bb common/options/crimson.yaml.in: Rename crimson seastar cpu cores c02273e4e34 common/options/crimson.yaml.in: Rename crimson seastar num threads 8ff129c89ff doc/dev/crimson: Update docs 51a4dd04da6 cephadm/cephadmlib: Eliminate false warnings about old sysctl conf files. 3a7e06ca48f src: Add sign-compare warnings to clang 9773be1ea4f mgr/dashboard: style fixes for shared components d0e0b6db36a doc/releases: remove RST-breaking indentation b06a68b4b80 os/Transaction: initialize unused fields in TransactionData f8fc29dfd5a common/Cycles: Add high-precision counter support for riscv64 77560484766 crimson/.../fixed_kv_node: don't call copy_out if delta_buffer is empty d13d7397f80 mgr/progress: compare up set instead of acting set beba28f2f4d rgw: add wildcard "*" support for conditional read f9b9bf3c6a9 rpm: require gcc >= 13.3 regardless of gts_version 897188f157a rpm: remove _lto_cflags logic for older distros 77c6ef8e3b3 rpm: remove special cases for gts_version < 13 ff93fcd2804 doc/rados: repair short underline 1b5f1ebbfc8 rpm: default to gcc-toolset-13, not just for crimson db264ddae86 crimson/os/seastore/CBJournal: correct needs_roll condition ced66f00d7b doc/cephfs: edit troubleshooting.rst 69353cfe247 RGW | fixed enqueueing the overwritten object for gc 914ea7f5760 qa/standalone/scrub: re-code osd-scrub-dump.sh to test scrub repair functionality. fa6c38c1d04 debian/control: install libnuma-dev unconditionally 4fc592eb64c mgr/smb: use lazy_init to create the rados store c2d235788c4 rgw/multisite: sync bucket obj_lock. add json encoding/decoding to members 6d058963adf rgw/auth: Remove legacy Keystone admin token 45776aa32e2 tasks/cephfs: Use different errmsg for invalid dir 3d8a6759c45 doc/cephfs: edit troubleshooting.rst 46346aa2d0b mgr/pg_autoscaler: Add 'osd pool get threshold' command which returns the current threshold value 56023c346cb crimson/os/seastore: don't apply backref extents' alloc deltas to cache 1a06854eefe crimson/os/seastore: add retire alloc remarks for backref extents to skip replay invalid deltas ea255486133 mgr/prometheus: fix enabled_modules check for smb metadata 99fe86670fc doc/cephfs: Update quota.rst 07372f1f627 doc/cephfs: edit troubleshooting.rst 4aa462b0917 mgr/dashboard: rgw_crypt_kmip_addr in SSE-KMS kmip address input field validation updated fixes : https://tracker.ceph.com/issues/72408 695680876eb mgr/cephadm: don't mark nvmeof daemons without pool and group in name as stray c050cc8b154 rgw: Update `run_coro` to use `redirect_error` and add tests c1d9a2618df common/async: `blocked_completion` uses our `redirect_error` b0f2bb760cc common/async: Add `redirect_error.h` 16542cb6925 qa: test_pool_min_size should kill osds first then mark them down ad7e6117a9e pybind/mgr/dashboard/frontend: add NPM_CACHEDIR envvar, use in bwc 98d48538c16 cephadm/smb: fix issue setting port of remote-control sidecar c141eabafb8 mgr/smb: update port validation to use new smb constants 9fa3433a99a rgw/restore: Update expiry-date of restored copies 57b138ff654 crimson/.../rbm_device: minor clean up 6f3229103e3 crimson/.../rbm_device: remove unnecessary zero fill in anonymous mmap 1864170a46d python-common: update smb service spec to use new smb constants b99f0296ff0 python-common: add a new smb sub package a8e89f690e3 qa: Add cauchy and 16K chunk size profiles 7ee026be4e7 qa: rados.py shouldn't clean up if test failed 8284dbb9691 crimson/os/seastore/rbm: remove duplicate code not to handling it twice f729614d660 crimson/os/seastore/rbm: fix incorrect reporting block size 38c6eea9393 OSD: add latency data to DEQUEUE_OP_END event 727e69db73e ceph-volume: drop udevadm subprocess calls a6491a8e849 erasure-code: Fix to set FLAG_EC_PLUGIN_CRC_ENCODE_DECODE_SUPPORT for ISA-L cauchy 13b64bd1834 erasure-code/consistency: Allow consistency checker to be able to deal with non-4k aligned buffers 30670d38dce test/osd: Move initialisation of overwrites and optimisation earlier in ceph_test_rados_io_sequence bcb542fde53 doc/cephfs: edit troubleshooting.rst 456b4d900ca pybind/rados: Add list_lockers() and break_lock() to Rados Python interface. 0478bf227e7 mgr/dashboard: [RGW] - Target Storage Class in s3 tiering config c99b06d15c0 doc: update cephfs-mirror replication 3281ccfe354 mgr/dashboard: Replace capacity threshold data with prometheus metrics 73a07686bd8 erasure-code: Enable EC optimizations for ISA-L cauchy c9d3f76b471 erasure-code: use cauchy if K and M values are not supported by ISA-L reed_sol_van 6dd393e37f6 osd: ECTransaction.h includes OSDMap.h b07d1f67625 osd: bypass messenger for local EC reads 7f4cb192513 osd: fix buildability after get_write_plan() shuffling 9d5bf623537 osd: just shuffle get_write_plan() from ECBackend to ECCommon dc5b0910a50 osd: prepare get_write_plan() for moving from ECBackend to ECCommon e06c0c6dd08 osd: separate producing EC's WritePlan out into a dedicated method eb3a3bb3a70 osd: fix unused variable warning in ClientReadCompleter ef644c9d29b osd: shuffle ECCommon::RecoveryBackend from ECBackend.cc to ECCommon.cc d43bded4a02 osd: drop junky `#if 1` in recovery backend debd035a650 osd: move ECCommon::RecoveryBackend from ECBackend.cc to ECCommon.cc 266773625f9 osd: replace get_obc() with maybe_load_obc() in EC recovery 1d54eaff41e osd: abstract sending MOSDPGPush during EC recovery e3ade5167d3 osd: prepare ECCommon::RecoveryBackend for shuffling to ECCommon.cc 1e0feb73a4b osd: squeeze RecoveryHandle out of ECCommon::RecoveryBackend bc28c16a9a8 osd: just shuffle RecoveryMessages to ECCommon.h 05819260351 osd: prepare RecoveryMessages for shuffling to ECCommon.h 6ead960b23a osd: ECCommon::RecoveryBackend doesn't depend on ECBackend anymore c9d18cf3024 osd: fix buildability after the RecoveryBackend shuffling 98480d2f75a osd: just shuffle RecoveryBackend from ECBackend.h to ECCommon.h dd7bdd32381 client: bring client_lock out of statfs helper method 9ab1209a68d client: move mref_reader check in statfs out of helper 61c13a9d097 test: Add test for libcephfs statfs 85f9fc29d20 client: get quota root based off of provided inode in statfs 5fe6497610d mgr/dashboard: form and style fixes 11175263756 doc/man/cephadm: update --orphan-initial-daemons argument description 485f37ac1fe qa: Disable a test for kernel mount 13efe8c6b89 rgw: Verify key id before sending to Barbican a9ff4f50db6 test/crimson/seastore/test_omap_manager: faster check mappings 069bede145e test/pybind/cephfs.pyx: add tests for chown() 325ae1163eb cephfs.pyx: handle when UID/GID passed to chown() is -1 a15653a2fbb doc/cephfs: edit troubleshooting.rst 3e7009d510c doc/mgr: more consistent capitalization in smb.rst e74227f3beb doc: document remote control in the mgr smb file 8417d2c078c .github: only run redmine-upkeep actions from ceph/ceph.git 057639d55ad script/redmine-upkeep: add transform to resolve merged issue 771a10027c8 tools: ceph-objectstore-tool check for invalid pgid 994d2edf228 script/redmine-upkeep: set default filter name/priority 4bed91ce980 script/redmine-upkeep: raise exception for PUT failures f31189996cb script/redmine-upkeep: finish transform after application b44b0a64537 script/redmine-upkeep: indicate log location in comments bd768b6d5c7 script/redmine-upkeep: check envvar to see if running as action 4550a5d6818 script/redmine-upkeep: bullet issue list 0f83dfba94c script/redmine-upkeep: add stronger note on upkeep-failed tag in failure message 77a16ef1639 script/redmine-upkeep: do not raise commennt if upkeep-failed already present 76048cc2e46 script/redmine-upkeep: correct filter out of upkeep-failed d8cec9683d7 .github/workflows: allow redmine-upkeep to write comments 07013240f50 test/crimson/seastore/test_omap_manager: add monotonic inc UT 783f0e3a990 qa: Adding a new class for the daemonwatchdog to monitor 83b8751519b mgr/smb: add tests applying & showing tls credential resources 7a7cacc462b mgr/smb: add a tls credential resource test case 1f74b5d81df mgr/cephadm: support tls creds via uri in service spec ef84df2f45f mgr/smb: make tls credential types work in smb show 657fe407e79 mgr/smb: add tls credential and remote control support to handler b624222df09 mgr/smb: remove unused generate_smb_service_spec function 4fe14549779 mgr/smb: add tls credential support to staging d4819d61d54 mgr/smb: add external store key func for tls credential resources 719fee7b160 mgr/smb: add a new entry class for tls credential resources 2789802fc14 mgr/smb: add a uri lookup func to the MonKeyConfigStore 8254069dba5 mgr/smb: extend the mon key store to support raw data b5e0ab8547b mgr/smb: add support for tls credential resoruces to sqlite store 6d9e126eb25 mgr/smb: add a RawConfigEntry protocol type 2698e050d86 mgr/smb: add a remote control configuration to cluster resource ccd7475f645 mgr/smb: create a new resource component for remote control ee5b41981a4 mgr/smb: add a new tls source component resource 173b538c2b5 mgr/smb: add a new tls credential resource type dedbeba39f7 os/bluestore: remove bluefs max_alloc perf counters c826e155538 common/perf_counters: track maximum increment value for LONGRUNAVG perf 39f73e2b792 mgr/smb: add a new BigString helper type for serializing yaml 62347a15914 mgr/smb: use a private constant for hidden value indicator d54fabceb45 mgr/smb: add a new store namespace for tls_creds e5ac8997283 mgr/smb: add a new generalized enum for source references 64c318c14cd mgr/smb: add a new TLSCredentialType enum 2327708b07a mgr/cephadm: copy tls blobs from smb service spec to smb configuration 56fb07fad11 mgr/cephadm: add a helper function for setting up smb config 09da84fe187 python-common/deployment: add remote control sidecar config params 4180cddc1a0 cephadm/smb: add support for remote control sidecar 87f5a3d9a83 cephadm: update type of populate_files first argument 917609b23fa mgr/smb: improve error handling when _customize_resource is wrong 4be5d428ca9 mgr/smb: add a wrapper_type attribute for resourcelib fields 24955e66f48 mds: rollback the snapdiff fragment entries with the same name if needed. daf3350621c test/libcephfs: Polisihing SnapdiffDeletionRecreation case 48f5a5d04fb Test failure: LibCephFS.SnapdiffDeletionRecreation Reproduces: https://tracker.ceph.com/issues/72518 Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io> e60d0317af8 rgw: Replace deprecated Barbican payload endpoint with alternative 8a213d29ed0 crimson/os/seastore/transaction_manager: linking retired placeholders to lba leaf nodes must be synchronous with getting child pos fbe60f1097e crimson/os/seastore/2Q: don't add empty extents to the warm out queue 8d30cff9e2a crimson/os/seastore/lba_manager: consider mutation pending extents when asserting the validity of their parents e3b91ff788a crimson/os/seastore/cache: avoid unnecessary transaction extent sets queires 50d70361e2b crimson/os/seastore/cached_extent: rename get_transactional_view to maybe_get_transactional_view 02c012d93c6 crimson/os/seastore/cache: no need to add extents to Cache::extent_index once SeaStore is fully booted 6692edfe70c crimson/os/seastore/btree: allow fixed-kv-btree to query Cache when getting child nodes during the booting 415059c92f4 crimson/os/seastore/cache: get_absent_extent doesn't need to query cache anymore 15cb6c7682c crimson/os/seastore/transaction_manager: invalidate RetiredExtentPlaceholder when reading extents 25be5fd3949 crimson/os/seastore/transaction_manager: link RetiredExtentPlaceholder onto lba leaf nodes 5fbb02aad4b crimson/os/seastore/transaction_manager: always try to get the extents to remove before removing mappings fe714e9f84d crimson/os/seastore/lba/btree_lba_manager: remove _decref_intermediate() 4c6577e9b60 crimson/os/seastore/lba_manager: decrease intermediate mappings' refcounts by calling update_refcount instead of _decref_intermediate 79729c4ece9 mgr/dashboard: close token status subscription properly ffabf23cccc container: pass CUSTOM_CEPH_REPO_URL thru container build script ec3be940fe8 container: add CUSTOM_CEPH_REPO_URL build argument ead0d4893e3 test/librbd/fsx:: Initialize effective_size variable to prevent undefined behavior 3df1133c17b neorados/cls/fifo/detail/fifo: include strtol.h aef51d29114 fixing format e7b6504aee5 test/crimson/seastore/test_omap_manager: refactor list UT baa901cf96b test/crimson/seastore/test_omap_manager: add innernode structural test 26765720b97 mgr/dashboard: fix memory leak in prometheus service 05f7cb615b6 mgr/dashboard: loading state for inventory card c89710706ab doc/cephfs: edit troubleshooting.rst 4a85e0d7381 crimson/.../string_kv_node_layout: switch linear to binary search 5cdbea89f2d crimson/os/seastore: mkfs_managers() into coroutines d08bb1d5cce crimson/os/seastore: cleanup final base_ertr users 22ad727fed7 crimson/os/seastore: introduce with_repeat_trans_intr f42e87b43dc crimson/os/seastore/transaction: Cleanup journal_seq_t users a821f574588 crimson/os/seastore/transaction_interruptor: include transaction.h 394f4463a43 crimson/os/seastore/transaction: fix circular dependency 6d35340511e crimson/os/seastore/btree/fixed_kv_btree: use common base_ertr cb1fda822a6 crimson/os/seastore/backref/btree_backref_manager: use common base_ertr 5164e8e9899 crimson/os/seastore/object_data_handler: use base_iertr 2d279d82622 test/crimson/seastore/test_omap_manager: add heavy update UT 012d38c8958 doc/cephfs: edit troubleshooting.rst 6f62b74b04d doc/cephfs: edit troubleshooting.rst 8a110623174 crimson/seastore/async: Use common base_ertr and base_iertr f20f02b0a38 crimson/os/seastore/onode_manager: use common base_iertr f36dfd73143 crimson/os/seastore/cache: remove Cache::base_ertr and iertr 5ca1b2be908 crimson/os/seastore/seastore_types: introduce base_ertr 8ebb5e115fb crimson/os/seastore/cached_extent: remove transaction_interruptor e736552756c test/crimson/seastore/test_omap_manager: add a UT to reproduce issue 72270 a0e457ad687 crimson/.../omap_btree_node_impl: pass pivot_idx for balancing a17fd3f41b3 doc/cephfs: edit troubleshooting.rst ee6c4eb393b suites/rados/cephadm: typo in ignotr list for still running message e56c7b9f7dd crimson/.../ephemeral: replace sleep(1ms) with seastar::yield() ce2c913d13a crimson/.../ephemeral: remove unnecessary zero fill in anonymous mmap 93ec459ab78 nvmeof: create /dev/dsa if DSA acceleration is enabled and the device doesn't exist 46f119716f6 doc/cephfs: edit troubleshooting.rst b627eb4995e doc/cephfs: edit troubleshooting.rst edb3d2be60f doc/cephfs: edit troubleshooting.rst 9d6a2242915 ceph-volume: avoid RuntimeError on ceph-volume raw list with non-existent loop devices df984d72df1 mgr/dashboard: Stop rules api being polled on every page 0a8fb009c4f prometheus: Add OSD full and nearfull ratio to prometheus 2989cb99df7 mgr/dashboard: fix table dom re-rendering 8547e57ebc4 qa: Add test for subvolume_ls on osd full 57e7be73d8c doc/cephfs: edit troubleshooting.rst f858759f918 test/crimson/seastore/test_omap_manager: redesign test variable sizes ab26edd603e debian/ceph-osd.install: add packaging for crimson-store-bench 4afb1355621 ceph.spec.in: add packaging for crimson-store-bench 41430cb4c95 crimson/tools: Added PG log and rgw_index workload 33d23128d62 crimson/tools: add store-bench f682244d86e doc/radosgw: Small fixes and improvements in notifications.rst, part 2 f5efad4a37d doc/radosgw: Small fixes and improvements in notifications.rst, part 1 9bb17010444 RGW: multi object delete op; skip olh update for all deletes but the last one 4ffc0de450e mgr/cephadm: adding description to hashed dependencies for debugging 3dea1b58148 mgr/cephadm: fixing Prometheus dependencies calculation d1ba8e9c56a mgr/cephadm: adding automation for Prometheus config generation 834323c1e17 mgr/cephadm: adding needs_monitoring flag 44510fd3721 mgr/cephadm: moving service_discovery.py to services module 0b70e32caba updating review comment 40d60f2a2a2 test/crimson/seastore/CMakeLists: re-enable seastore unittests b9b83498ef8 test/crimson/seastore/CMakeLists: tune ASan's UAR fake stack size 80517806eb9 doc/install: Small improvements in manual-freebsd-deployment.rst 1ca8f334f94 mds: Fix readdir when osd is full. 9c4cd107a41 ceph-mixin: Update monitoring mixin c55eb8ad52b doc/cephfs: edit troubleshooting.rst 7c8e38155d6 doc/cephfs: edit troubleshooting.rst bb93aa3e7bf rgw/datalog: Stick noexcept on wrappers returning int 47329444b8c rgw: Use `run_coro` to call coroutines at use 9f17b631ded rgw: Add run_coro utility e81d4eae4e7 common/async: Update `use_blocked` for newer asio 924acd1f2c1 nvmeofgw: cleanup pending map upon monitor restart fixes https://tracker.ceph.com/issues/72434 0c6a8add81c client: use path supplied in statfs 07c77b0c886 common/async: Add concepts.h 26ef4862c6a common/async/co_waiter: Add missing header 9d4968b4a07 rgw/multi: Fix error handling in public Datalog APIs b84d7e35307 rgw/admin: Fix assert on datalog list of invalid shard 45db5f38b0a prometheus: Add RBD image metadata to prometheus f108d4039d5 test/standalone: a minor cleanup of scrub-helpers.sh eb5be7cccaa test/standalone/scrub: improve build_pg_dicts() performance 190050bfb3e mgr/dashboard: 72409 : Fixed parsing error in grafana for host overall performance iframe fixes: https://tracker.ceph.com/issues/72409 64361708338 mgr/dashboard: Made grafana iframe scrollable and height consistent Fixes : https://tracker.ceph.com/issues/72044 4ce8b5210d6 mgr/dashboard: fix nvmeof mtls 386954de5ca doc/rados: Fix broken links 5afc446fdaf osd/scrub: do not limit operator-initiated repairs d67639986d7 doc/cephfs: edit troubleshooting.rst ed1699a7cce libcephfs: New test file for high-level record locking c6c3a1f1654 doc/install: Linkify mention of ceph.conf and use ref for links ae89a562ee5 rgw/datalog: Manage and shutdown tasks properly 2f9bebd8713 rgw: auto-create missing bucket index shards during reindex operations a2d26647c01 neorados/fifo: Rewrite as proper I/O object 14ddf3c1906 {neorados,osdc}: Support subsystem cancellation 4c0f4220e6f rgw/multi: Give tasks a reference to RGWDataChangesLog 24e67fa8112 neorados: Hold reference to implementation across operations 4748c145545 qa/suites/orch/cephadm: ignore intentional OSD_DOWN warning from test_host_drain task 42b249087a0 mgr/dashboard: Fixed incorrect snapshot scheduled date for rbd block in GUI fixes: https://tracker.ceph.com/issues/72288 4fe46438616 monitoring: Add per share metrics to SMB dashboard 447ea3fff9e rgw/notifications: test refactoring 185987afff5 doc: erasure coding enhancements for tentacle 7092d2cddf4 doc/rados: Remove obsolete fs-recomm links d4be6b32452 doc/rados: Use ref instead of relative external links 39af0bc23b3 common/ceph_context.h: Jenkins builder fix: breakpad reserve space 969c01fd547 doc/cephfs: edit troubleshooting.rst 8429ee39f25 common/filepath: un-inline methods to reduce header dependencies c85149ed24a include/types: un-inline methods to reduce compile times 206cdb1c774 include/object: un-inline methods to reduce header dependencies e08850bf70d common/dout: include cleanup 640273d0d9e common/ceph_context: include cleanup 5f1a893dc54 include/frag.h: un-inline methods to reduce header dependencies b0952047f0a include/uuid: un-inline methods to reduce header dependencies 4457ad220d9 common/DecayCounter: un-inline operator<< a92e1fda1dd common/TrackedOp: un-inline several methods to reduce header dependencies 7a154f60571 include/utime: un-inline iostream code to reduce header dependencies 4c613b55f73 common/entity_name: un-inline methods to reduce header dependencies b9649959d4b common/entity_name: forward-declare class entity_name_t 6b9ba02266a common/entity_name: add missing includes 6eb341b22db common/snap_types: un-inline methods to reduce header dependencies 192e9691c52 include/utime: un-inline several functions to reduce header dependencies a703c99b4b2 include/CompatSet: un-inline to reduce header dependencies 1108f4e46c8 common/ceph_json: un-inline encoding methods 3e7fdf84220 include/uuid: include boost/version.hpp for BOOST_VERSION 3605608c5d9 auth: add missing include 4b78bdef09a common/io_exerciser: add missing includes 2dbfe0e51ab global/signal_handler: add missing includes 1010fb4a515 test: add missing include 850491c1134 msg/Messenger: add missing include 7102a0b03a7 os/ObjectStore: add missing include d5b8797783f rgw/driver/rados: add missing includes ea36a76f9b1 rgw: add missing includes 0fffa230177 tools/ceph-dencoder/CMakeLists.txt: add missing dependencies to denc-mod-common 47117d9f16e tools/ceph-dencoder: remove "using namespace std" 30ffda19bad crimson/os/seastore/transaction_manager: complete indirect mappings before reading 9e89c3c7438 crimson/os/seastore/lba_mapping: treat indirect mappings as valid non-clone ones 01964fd5493 crimson/os/seastore/lba_mapping: treat indirect mappings as valid non-zero-reserved mappings 7f9f1c551c2 crimson/os/seastore/lba_mapping: add interfaces to determine the pending state of mappings' child extents b1d0d9d535b crimson/os/seastore: laddr_offset_t can align to mulitple UNIT_SIZE now d370ec8c943 crimson/os/seastore/lba_mapping: drop the deprecated "duplicate" method 952e486a09c crimson/os/seastore/cached_extent: more correctness asserts c6b2aa356f1 crimson/os/seastore/transaction_manager: hide TransactionManager::remap_pin() 8f76bbfcdce crimson/os/seastore/object_data_handler: LBACursor based clones 20707815a9e crimson/os/seastore/object_data_handler: cleanup deprecated functions bbcf328ec6c crimson/os/seastore/object_data_handler: LBACursor based overwrite 51225f4087b crimson/os/seastore/lba_mapping: make LBAMapping duplicate light-weighted and safe 218ccbc82a3 common: remove seastore_obj_data_write_amplification 721350e659b crimson/os/seastore/btree: allow BtreeCursor to represent the end of the tree 2beb38219df crimson/os/seastore/lba_manager: add LBACursor related interfaces bc7916fed5e doc/radosgw: Small improvements in kmip.rst c6104f643b9 doc/radosgw: Small improvements in s3-notification-compatibility.rst ca35c0de428 mds: skip charmap handler check for MDS requests 5d983a46b01 qa: test for charmap handling on reintegration 12714e31b45 rgw, common: OpenSSL provider support b4304d521f6 mgr/DaemonState: Minimise time we hold the DaemonStateIndex lock 9f16f29511b dependabot: stop dashboard npm upgrade PRs 7e864427fad doc/radosgw: Use ref for hyperlinks, 2nd batch 9b534846c65 doc/cephadm: Small improvements in services/tracing.rst d49ae976c84 doc: Erasure Code: Document set CRUSH rule precedence vs EC profile 40e5395db6c doc: Use ref instead of full URLs for intra-docs links bf460934700 doc/cephfs: update cephfs disaster recovery procedure d471748aa0c doc/cephfs: add a note about estimated replay completion time 6e9db91d1ca mgr/dashboard: user accounts enhancements fa8edac847d doc: fix formatting, typos in mon elections and stretch mode edffff8135c doc/man/8: Fix link in ceph-objectstore-tool.rst 52915db9507 osd: Optimised EC avoids ever reading more than K shards (if plugin supports it). 5de7e746b79 auth: msgr2 can return incorrect allowed_modes through AuthBadMethodFrame 8068ea15dc8 mgr/dashboard setup husky 6a0cf4493af doc/rados: Fix more mClock links in ops/monitoring-osd-pg.rst be22efd685a doc/man/8: Fix links in rgw-policy-check.rst babd3c00341 src/nvmeof/NVMeofGwMonitorClient: connect panic ffb8ff5dfcc mgr/dashboard: fix cypress tests 90b53c2537d mgr/dashboard: add reusable carbon popover e74694a3a0d fix: Swift API conditional write if_none_match 422abb7b69b libcephfs_proxy: optimize ceph_chdir/ceph_getcwd 579ca2369b1 libcephfs_proxy: enable the embedded perms feature 594c53be8a6 libcephfs_proxy: check requirements for embedded perms on connection 68505c3e3a3 libcephfs_proxy: implement client side support for embedded perms cde17574cf4 libcephfs_proxy: extend the protocol to support embedded permissions 52fba7af44c libcephfs_proxy: add protocol version negotiation 50ea6b1665c libcephfs_proxy: introduce protocol versioning 8c10c1b686e libcephfs_proxy: rename and cleanup some protocol definition macros 6ad4bd16480 mgr/dashboard: introduce details card component c7f418eecbf doc/cephfs: edit ceph-dokan.rst (3 of x) 9cf5cfa8eaf crimson/os/seastore/lba: remove refresh_lba_mapping 680475c72c4 crimson/os/seastore/lba_mapping: add next() to get the next adjacent mapping 19d12831f87 crimson/os/seastore/lba_manager: replace refresh_lba_cursor() with cursor.refresh() dfd8bdbce24 crimson/os/seastore/lba_mapping.h: allow null direct_cursor in indirect mappings 726bb5a95de mgr/cephadm: don't use list_servers to get active mgr host for prometheus SD config ee0364761e1 mgr/cephadm: add interval control for stray daemon checks 92a371e4377 doc/rgw: document support for S3 Object Ownership 696251c9773 rgw/admin: 'bucket chown' skips object acls for BucketOwnerEnforced e834454a6d5 rgw/s3: add Put/Get/DeleteBucketOwnershipControls 5ed9b1f3aa5 rgw/s3: ObjectOwnership interacts with canned acls 373d638b6fc rgw/s3: reject PutBucket/ObjectAcl for BucketOwnerEnforced 0b05b342308 rgw/s3: authorization ignores object acls for BucketOwnerEnforced ca1c2593ab8 rgw/sal: move sal::Attrs alias to rgw_sal_fwd.h f97e90d0966 rgw/s3: CreateBucket accepts x-amz-object-ownership header b3733296c8e rgw/s3: add ObjectOwnership and OwnershipControls b5a013f6170 test/rbd-mirror: eliminate a race in ResyncRequestedRemoteNotPrimary 6ca2848006b cephadm: improve hw qat experience with cephadm fcce415a351 mgr/prometheus: add share name as label to SMB_METADATA metric 4d65098c874 monc: synchronize tick() of MonClient with shutdown() aeefebd81b9 qa/suites/upgrade: update ignorelist with cephfs specific warnings (under stress-split) c0fedb52fa6 mds/MDSDaemon: unlock `mds_lock` while shutting down Beacon and others 84757283b14 doc/radosgw: Simple fixes and improvements, links improvements a4155c27911 mgr/dashboard: Create and delete and update s3 notification in dashboard 24506b1e1c6 src/rgw: Adding "sync error trim" option b77ad8d0326 mailmap, githubmap, organisationmap: Add Steven Zuraski e1366bfffde mgr/dasboard: fix pool e2e 5398af89be4 libcephfs_proxy: remove REQ_CMOUNT and ANS_CMOUNT macros 0aa69fffd13 libcephfs_proxy: rewrite protocol structures definition e0d797da790 rgw/s3: support paginated ListBuckets cd3832eeaf9 mgr/dashboard: Fix cephfs tests 110919c7fec mgr/dashboard: fix mirroring e2e e0dd0fdc8f0 mgr/dashboard: fix pool tests 5bec6b80667 crimson/.../fixed_kv_node: add assertion for pivot_idx validity 271cf4f24c1 crimson/.../lba_btree_node: add assertion for pivot_idx validity 88a72337ad3 test/crimson/seastore/test_omap_manager: add a UT to reproduce issue 72303 e8f8879ceda crimson/.../linked_tree_node: fix pivot_idx assertion in balancing 6ed8e86ce84 qa/suites/crimson-rados: Introduce objectstore_tool testing 35e0ed913a4 qa/tasks/ceph_objectstore_tool: Support Crimson tool 059a730940f mgr/dashboard: cypress tests do not fail on failures 9dc57f9e2da doc/cephfs: edit ceph-dokan.rst (2 of x) 57deafb0c1d mgr/cephadm: Allow registry credentials to define multiple container registries 0a2d4b096af doc: Fix links to mClock config reference d24da381a4c qa/cephfs: increase clones for test_for_6_ongoing_clones 03f0920ec63 qa/cephfs: fix exception message b5cbc46fecc Replace SHA256 with faster hash calculation using BLAKE3 b2d278793c8 rgw/dedup: tech preview for full object dedup support which means duplicate objects will be deleted (until now they were only reported) d4eadb5739a doc/man/8: Fix small errors and small improvements in mount.ceph.rst 7cf2b5fd22d mgr/dashboard: introduce details card component 230d91c2e28 doc/man/8: Improve mount.ceph.rst c2e0c157d03 common/async: fold async_spawn_throttle_impl into spawn_throttle_impl 4956c638e61 common/async: remove null_yield support for spawn_throttle 1cefcae2a95 common/async: remove null_yield support for max_concurrent_for_each() cd0b62f48eb rgw: RGWSI_Notify spawns a coroutine on null_yield 60ba07ae5c6 rgw: RGWDeleteMultiObj spawns a coroutine on null_yield fb713c9130a mgr/dashboard: fix table loading while fetching data 9bfd6797446 qa/suites/krbd: use a standard fixed-1 cluster in unmap subsuite 9edb21215f4 qa/suites/krbd: request msgr1 explicitly in unmap subsuite 4d7cf5565d4 doc/man/rbd: update ms_mode default (legacy -> prefer-crc) 628ada5d954 mgr/dashboard: fix bucket replication disable 1503ee410a5 crimson/osd/../client_request: drop rwoedered with balanced/localize reads 9dcd329b51b crimson/osd/../client_request: rename is_misdirected and add logs 7cb32d013a1 crimson/osd: handle_osd_map to coroutines 7a34ea4e2f9 crimson/osd: committed_osd_maps into coroutines b6a500f70e1 crimson/osd: committed_osd_maps fix paramter types 176d1882041 pybind: replace deprecated license classifiers with SPDX expression 9c7cc0b9a1b crimson/os/seastore: fix incorrect total space reporting when using multiple shards in RBM ce8ecd39f17 mds: fix ineffective 'false' parameter due to virtual inheritance c0dd7cbb785 fuse: improve error handling in fuse_ll_getattr 94c4ffa64af tools: make rados ls aware about the locator concept 803140e9211 doc/cephfs: edit ceph-dokan.rst (1 of x) 54b4582199d compressor/zstd: correct buffer end detection using get_remaining() 534fc76d40a osd: Optimized EC invalid pwlc for shards doing backfill/async 9f0e883b710 osd: Optimized EC add_log_entry should not skip partial writes 0b19ed49ff7 osd: Optimized EC apply_pwlc needs to be careful about advancing last_complete 846879e6c2e osd: Use std::cmp_greater to avoid signedness warnings. 4948f74331c osd: Always send EC messages to all shards following error. 417fb71c9b5 osd: Attribute re-reads in optimised EC 1fa5302092c osd: EC optimizations keep log entries on all shards 1c2476560f1 osd: Remove some extraneous references to hinfo. 00aa1933d34 mon: Optimized EC pools preprocess_pgtemp incorrectly rejecting pgtemp as nop 0b8593a0112 osd: EC Optimizations proc_master_log bug fixes 89fef784aa4 osd: Fix issue where not all shards are receiving setattr when it's sent to an object with the whiteout flag set. 9f9ea6ddd38 osd: Relax assertion that all recoveries require a read. 3493d13d733 osd: Recovery of zero length reads when we add a new OSD without an interval. 0c89e7ef2ab osd: Relax PGLog assert when ec optimisations are enabled on a pool. a39a3096314 osd: Truncate coding shards to minimal size 83a9c0a9f8e osd: EC Optimizations fix peering bug causing unfound objects 3310f978591 osdc: Optimized EC pools routing bug ce53276191e mon: Optimized EC clean_temps needs to permit primary change 74e138a7c1f osd: Optimized EC pools - fix overaggressive assert in read_log_and_missing d8f78adf85f osd: rewind_divergent_log needs to dirty log if crt changes or ... rollback_info_trimmed_to changes 5d7588c051b osd: Correct truncate logic for new EC 564b53c4462 osd: Fix incorrect invalidate_crc during slice iterate 24cd772f209 osd: Do not apply log entry if shard not written 6c3c0a88b68 osd: EC Optimizations proc_replica_log needs to apply pwlc c116b8615d6 osd: Multiple Decode fixes. d2ba0f932c6 osd: Optimized EC pools bug fix when repeating GetLog 98eae78f762 osd: Fix attribute recover in rare recovery scenario 1352868cec8 osd: code clean up and debug in optimised EC c6d2bb9f647 osd: EC Optimizations fix bugs in applying pwlc to update info and log 3909c6554cd radosgw-admin: Pass max_entries for bucket list 4d44d5e4c83 doc/releases/squid: More notable changes in RGW b99a47f1cb6 RGW | Added debugs in cases where precondition check fails 415bf4dd777 librbd/mirror: cleanup EnableRequest::handle_get_mirror_image() 9489931cbde mgr/dashboard: Fix issue with loading localization module 3a350446fef Revert "mgr/dashboard: Fix stylus issue" a577f6fa405 krbd: "rbd device map" command should use msgr2 by default 86c420445c8 mgr/dashboard: add support for toast alert panel 33359682278 test/crimson/seastore/test_seastore: add UT for OP_SPLIT_COLLECTION2 5208cc641e4 crimson/os/seastore: add support for OP_SPLIT_COLLECTION2 5020c79ae13 doc/mgr: add documentation for bind_addrs option a753fb18cd4 mgr/smb: add bind_addrs field to cluster resource type fc454307220 cephadm: add support for specific network binds to smb service 414300201aa mgr/cephadm: pass bind_networks with other smb config blobs 512e2585353 mgr/cephadm: teach ctdb nodes logic about bind_addrs 1afb07b0c39 mgr/cephadm: add filter_host_candidates method to smb service class 6bbd55dda7a python-common/deployment: add bind_addrs and related type for smb e43800e968f mgr/cephadm: teach serve.py about host selector support e3a3334f2cc mgr/cephadm: prepare schedule.py for per-service-type host filtering 2996390144f script/build-with-container: Add Rocky 9 add0dc2c960 install-deps: Add Rocky 9, combine if statements 47a15af8ddb ceph.spec.in: install crimson-objectstore-tool e49a8a41279 Crimson: Implement crimson-objectstore-tool 37df8e43baa doc/cephfs: edit disaster-recovery.rst 18e9b08393c doc/radosgw: edit config-ref.rst c7053dff52b mgr/dashboard: Fix stylus issue 9e0488dd0bd client: crash caused by invalid iterator in _readdir_cache_cb aec2c13b2bc crimson/os/seastore/logical_child_node: LogicalChildNode should respond to the invalidation event e7fa4581736 crimson/.../linked_tree_node: fix incorrect end offset calculation e14afbc95a5 rbd-mirror: prevent image deletion if remote image is not primary 9f600a8136a libcephfs: Update the .organizationmap and .mailmap files Please enter the commit message for your changes. Lines starting 6b443ee5a4e libcephfs: Add ceph_setlk and ceph_getlk wrapper functions 22e5db4dc71 Client: Add Client::setlk and Client::getlk functions 57910d582ea mgr/dashboard: Fix redirection of SMB enable module - taking to dashboard page due to remains of `buttonToEnableModule` 92fb5863767 mgr/dashboard: Add RGW bucket notification listing in dashboard 3679175b16a cephfs: add untracked files to ceph.spec.in and debian installs 5c6f9d84fe5 include/cephfs/types.h: move dump() methods to dump.h 4d7941f93a6 include/fs_types: un-inline operator<<(inodeno_t) 7ed0de7887c include/fs_types: un-inline inodeno_t::dump() a56aede3ef4 include/ceph_fs: un-inline encoding functions 8b822b3bc4f common/ceph_fs: include cleanup 8244685cb38 include/cephfs/types.h: move JSON methods to json.h c914920e6bf include/cephfs/types.h: move struct keys_and_values to separate header 308f3beb57e include/cephfs/types.h: include cleanup 09adf8f43c3 libcephfs: add missing include 9136ed3c704 include/fs_types: add missing includes bbece46124f rgw: Add parameter to `get_storage` to indicate radosgw-admin call 6ccdc21bd70 doc: squid 19.2.3 release notes 75ff229c786 rgw/iam: documentation get-account-summary 23207513ae5 rgw/iam: getAccountSummary API 55f5b762c67 RGW | fix conditional Delete and MultiDelete e2d961fc42a mgr/cephadm: use same tag for all samba images bcc1e34a28e mgr/dashboard: Storage Class - Update 891e9cf2492 doc/cephfs: edit disaster-recovery.rst 36b96ad56f0 qa/suites/rados/thrash-old-clients: Add OSD warnings to ignore list c6625a61e73 tools/ceph-dencoder: do not test HitSet types 928aa98c1dc auth: remove unused AuthTicket::renew_after member variable 8cc59e6a1f2 crimson/os/seastore/rbm: improve large sequential write by issuing writes in parallel ef055d4b7fd osd: Replace deprecated std::align_storage_t with alignas bb52430eb31 mgr/dashboard: add support for inline-tip notification bda4473dc83 crimson/.../omap_btree_node_impl: fix inner node iterate c78dca1dd53 doc/radosgw docs get-caller-identity API d01003ec504 osd: recalculate coll_t::_str during decode() to fix stale values 6f14d6f25f0 mgr/dashboard: add rollup as optional deps 92ab603e110 src/test/mds: Fix TestMDSAuthCaps 45a1280e8a3 qa: Run RADOS suites with ec optimizations on and off eb406df08cb crimson/os/seastore/async_cleaner: make gc_formula configurable 15dbdd65de7 crimson/os/seastore/extent_placement_manager: make MIN_COLD_GENERATION and MAX_REWRITE_GENERATION configurable ada324bb5c9 crimson/os/seastore: remove unused L_ADDR_ROOT 9c8490fc2ba qa/crimson/seastore: use new cachepin size pershard option 65fca0a9f47 crimson/os/seastore: add metrics about hit/miss of ExtentPinboard aee4c078c2d crimson/os/seastore/ExtentPinboardTwoQ: display more access stats about each queue 6a0d1ad9890 crimson/os/seastore/ExtentPinboardTwoQ: don't promote extents that were partially read from the last access end 89ef637e626 crimson/os/seastore: set laddr before touch_extent during replay 36d4ad5684f crimson/os/seastore/ExtentPinboard: introduce TwoQ algorithm 57e605ddb41 crimson/os/seastore: move extent link state predictes out of ExtentQueue d0fb90cf694 crimson/os/seastore/CachedExtent: add/rename the help methods of intrusive hook 2f7738dd271 crimson/os/seastore/ExtentPinboardLRU: make ExtentQueue standalone 820e2f7b27c crimson/os/seastore: move Cache::LRU out of Cache b9a03d19529 rgw: DeleteObject supports sigv4 with Transfer-Encoding: chunked d713e9a583c qa/rgw: remove hadoop-s3a subsuite 97de817ad1c osd/scrub: allow auto-repair on operator-initiated scrubs 278f3f6a351 test/crimson/seastore/test_omap_manager: redesign test basic 6eb989043ee improve error handling and add --resume flag to 'ceph rgw realm bootstrap' for partial recovery ac14330994f librbd: Clean up usage of IoCtx 648cfd9236d imgr/cephadm/nvmeof: Add "force TLS" flag to NVMeOF spec file. 702dfddf230 mgr/dashboard: nvmeof cli rename ns to namespace, fixes for text responses, subsys add params 693eabf58cc librbd: images aren't closed in group_snap_*_by_record() on error af9038831e0 rgw/test/notification: add more info when retry test fail b1d6bb95d3c client: Fix the multifs auth caps check 1a5e083eb29 mds: Fix multifs auth caps check f10e34d0350 qa: Fix validation of client_version 3516db300d3 qa: Test cross fs access by single client in multifs a4ef269d1e4 qa: increase the randomness to trigger the directory import/export eb6278e441c Add a new flag to the IO exerciser which enables live consistency checking during IO sequences (disabled by default). a4d93bb5543 Get chunk size for consistency checking from EC profile instead of command line arg 74925d76214 src/ceph_osd, osd: Implement running benchmark during OSD creation c907049c0a5 build-integration-branch: allow setting git trailer on final commit 5ce45a2ca3e build-integration-branch: convert to argparse f93afc47467 mgr/dashboard: split ns add to separate api and cli functions 8a4820677e6 build-integration-branch: add a main function 10038ec67eb rgw/posix: Create default user cb48627df68 rgw/posix: Remove DBStore dependency a19834c2bbd doc/radosgw: Improve formatting and language in bucket_logging.rst 06658fdac16 osd: Deduplicate zeros in EC slice iterator e928779faa4 buffer: raw_zeros mprotects the zeros efcac634185 buffer, test: bl::append_zero2() deduplicates zeros, introduce bptr::is_zero_fast() 6fddc83e266 deb/cephadm: add explicit --home for cephadm user 47bed731d3b doc/radosgw: Internal link and single-keystroke improvements a6e688551a0 rgw/sts: GetCallerIndentity API 35ec3cd2bb9 get_caller_identity utility ac2e5f50252 doc/radosgw: edit "Lifecycle Settings" 17730571f59 test/crimson/seastore/test_omap_manager: add unit test for clear a5824d03e28 cmake: link memstore against os 49c0fd0d136 doc/radosgw: Small improvements in s3_objects_dedup.rst 1002fe77bd8 include/function2.hpp: avoid using std::aligned_storage_t 917a2dde418 rgw: pass list_parts_each_t function by lvalue reference f7f93b2c7a8 mgr/dashboard: add help for nvmeof cli 6dffa503a2b qa/suites/upgrade: add "Replacing daemon mds" to ignorelist 68766699baf mgr/dashboard: Glacier Storage Class - create and list Fixes: https://tracker.ceph.com/issues/71897 09d27310b3b osd: migrate from boost::variant to std::variant cd4d7a315d3 test/run-cli-tests: inherit ASAN_OPTIONS and LSAN_OPTIONS e623180f81c crimson/.../omap_btree_node_impl: fix complete flag for depth 2 omap list 5361c81069d librados: remove unused includes in librados_c.cc f2326237472 blk/kernel: cap single discard request's length e9d0f939b98 os/bluestore: make full device discard on mkfs a default behavior b6dd408c87b test: remove unit tests about cache tiering 89fcbcedb2f mgr/cephadm: fixing SMB service discovery UT 324bd5b0d5e mgr/cephadm/nvmeof: Add Prometheus filds to NVMeOF spec file. afd3cae520e test/osd: Unit test to verify optimised EC deep scrub functionality 4022d6e92ee test/osd: Add erasure coded pools support to test_scrubber_be.cc 92ccbff16bf osd: Deep scrubbing implementation for optimised erasure coding e343b0863aa mgr/dashboard: Notification endpoints for create ,list and delete a0dd52fe100 mgr/dashboard: set up dashboard as a app shell 6294904358d crimson/os/seastore/async_cleaner: measure io block time 2740007492c test/osd: Fix ceph_test_rados_io_sequence help documentation 6ec843a446d cmake: Remove unused cls_lock_client linkage b929fd0e6b5 test/osd: Disallow using testrecovery and parallel at the same time in ceph_test_rados_io_sequence df966b2bff5 test/osd: Fix issue preventing --testrecovery being passed correctly through to the pool creation code in ceph_test_rados_io_sequence 932af7392ec test/osd: Enable an application for pools created by ceph_test_rados_io_sequence a2c4cd15b5c test/crimson/seastore/test_omap_manager: redesign test leafnodes 4b638e702ee mgr/cephadm/nvmeof: Increase the default limit of max_namespaces Fixes https://tracker.ceph.com/issues/72108 aa2f60642df crimson/os: drop off omap_get_values with start 019a75c06a0 osd/SnapMapper: replace omap_get_values by omap_iterate in get_next d725a9faa41 test/crimson/seastore: check_omap replace omap_get_values by omap_iterate 3ccc8ecf4de osd/PGLog.cc: replace omap_get_values by omap_iterate f109ce9b85c crimson/osd/../scrub_events: replace omap_get_values() by omap_iterate() 97000a14389 crimson/osd/replicated_recovery_backend: replace omap_get_values() by omap_iterate() 9d102213d0f crimson/osd/pg_backend: replace omap_get_keys/vals() by omap_iterate() ed8ccc97fea test/crimson/seastore/test_omap_manager: test omap_iterate() e696da88f96 crimson/os: add omap_iterate interface to futurized store a5fbcdfafac script/redmine-upkeep: add Filter class 0708a89240f rgw/multisite: url-encode query param 'key-marker' in the bucket listing request 793bd38acd1 test/crimson/seastore/test_omap_manager: redesign test replay 4bff1f89413 script/redmine-upkeep: codify commit abbreviation 69d641f0207 doc: add note admonitions in two files 8f1fa0d1307 common: Add iterator traits to mini_flat_map and bitset_set iterator a05bb75cf27 erasure-code: Add new flag for whether plugins support encoding/decoding or CRCs 89eabfc3f0c doc: Clarify the status of MS Windows client support f08f7098508 qa/d4n: Update D4N suite a5dfb457452 rgw/d4n: Add shutdown calls to unit tests and save yield in filter 8c6f8919691 test/d4n: Add length to bufferlist vars 7c51f75ed77 test/d4n: Add dout initalization during env setup 8c578fc8ce8 test/d4n: Set config_store_type to dbstore a5c96eb57f0 cls/rbd: remove unused includes 15840558e4c test/pybind/test_rbd.py: remove skip_if_crimson 0f3b651fcc1 install-deps.sh: use gcc-12 for ubuntu jammy 7107c3283ac crimson/tools: remove usage of deprecated function at_exit() eeb0f9670df crimson/tools: Remove usage of at_exit() f09d3a771ca crimson/test_messenger: remove usage of deprecated function at_exit() 828f9fd4211 seastar: bump up seastar submodule 9de53c9ab53 mailmap, githubmap, organizationmap: Add Kautilya 291b40ee9a6 cmake: remove osdc/error_code.cc from osdc to fix ODR violation dee200029ef crimson/common: remove obsolete fmtlib version check 4de277a4105 crimson/common: replace deprecated fmt::localtime() with localtime_r() 329ee7b3038 doc/cephfs: Improve mount-using-fuse.rst 0e80573832e .github/workflows/redmine-upkeep: use pull_request_target e8fd257df01 ceph.spec.in: don't rm ceph conf and logs in ceph-common postun 1dd42e1a339 mgr/dashboard:Fixed issue with clipboard icon eb845acda21 osd: _send_boot() doesn't put stale, cached cluster_addrs in MOSDBoot 2fc67a6fa53 mon/PGmap: Add warn description for bluestore fragmentation 50db194bc47 cephadm: Bind mount /var/lib/samba with 0755 8f2a88eb4dd mgr/dashboard: Fix smb module enablement 89e5e65ace6 mgr/dashboard: fixed input field black after selecting an autofill browser input fixes: https://tracker.ceph.com/issues/70720 f1359e16de3 rgw: fix typos in log messages eaab5a0bee0 mgr/dashboard: add missing commands for subsystem: change_key and del_key and missing params for host add 85503123c19 script/redmine-upkeep: handle invalid PRs c5b5408c5be mgr/dashboard: differentiate account users from rgw users in bucket form e214717fea8 mgr/prometheus: add smb_metadata metric 4a802b864a6 rgw/s3: remove 'aws-chunked' from Content-Encoding response 993f945c2c4 mgr/dashboard: add tab structure to File Systems page and embed Ceph-Filesystem Overview dashboard fixes: https://tracker.ceph.com/issues/72039 Signed-off-by: Abhishek Desai <abhishek.desai1@ibm.com> ae4da729282 osd: Remove all references to hinfo from optimized EC 12b9d735006 mdstypes: Dump export_ephemeral_random_pin as double ca238ba4990 filter/posix: Implement `POSIXUser` as store cf51fa1dc9f vstart: Remove dbstore directory if cluster is started as new fc4396d6280 doc: update mgr modules notify_types a86f6a6ce89 qa: increase the wait time to prevent check_counter failing 08d7363fb2e erasure-code/jerasure: fix memory leak in Galois field operations 6a37fc870a7 mgr/prometheus: fix metrics service not coming up 06e8fd11501 seastore: support validating device signature for ceph-lvm b303afed7a8 qa/standalone/scrub: fix "scrubbed in 0ms" in osd-scrub-test.sh 8a50d4ff8f5 doc/mgr: Add doc for comment and max_connections 2e8cb970d8c mgr/smb: Add configurable options to share 14cd29f7297 script/redmine-upkeep: trigger on merged PRs 2f2cb6089a9 .github: fix workflow format error de4d7a954a5 mgr/cephadm: updating maintenance health status in the serve loop 8654b1f202a rgw: hook up delete-marker detection 2b9c009e482 script: remove obsolete script 05419ae5f66 .github: add workflow for redmine upkeep 197fa512616 script: add redmine-upkeep script 5f5bf82e571 mds: Mark the scrub passed if dirfrag is dirty f4bcf5bfd53 MDS: disallow root directory fragmentation 9a1d01defb6 mgr/cephadm/nvmeof: Add susbsystem cache expiration field to NVMeOF spec file f990e7d1ea9 qa: Fix test_with_health_warn_with_2_active_MDSs 298ede02773 crimson/os/seastore/cache: extend extent lifecycle after wait-io 36badc97ae9 cmake: upgrade CMAKE_CXX_STANDARD from 20 to 23 7028ed21138 client: prohibit unprivileged users from setting sgid/suid bits 71c915486fd osd: Fix extent cache unit test b6fc0be439f rgw: Fix the version of struct RGWZoneParams 3fb3f892aa3 deb/mgr: remove deprecated distutils from ceph-mgr.requires 7d5f66e458b erasure-code: Add ceph_ec_consistency_checker into ceph_test_package a4f97c0aa92 qa: Run test_admin with the squid client 70642943be7 mgr/dashboard: rm requirements-extra file 3e4c2638f21 qa/workunits/rbd: remove build dependency on dashboard 517ab7612a2 rgw: fix bucket logging AuthType field c8004985799 crimson/os/seastrore/omap_manager: initialize rewritten omap nodes when preparing commit if the prior are seen by users after the nodes are rewritten 4d9d11c7c70 qa: deactivate snap-schedule to avoid race with snap delete e42339dc9e1 qa: test for bad retention period specifiers 272a67c1d36 qa: remove possibly created snapshots 32ced0c496e mgr/snap_schedule: restrict retention period multipliers set fa5160444e7 mgr/dashboard: Add generic component for icons fe3b4159b82 mds: add ref counting to LogSegment 8580fd50d8e mgr/dashboard: Remove the time dropdown from grafana iframe. fixes: https://tracker.ceph.com/issues/71907 27c2050e37e mgr/dashboard: add an option to control the dashboard crypto caller 2128ffa619c mgr/cephadm: always use the internal cryptocaller f6ab08783c0 python-common/cryptotools: catch all failures to read cert 0eb2f4b1327 python-common/cryptotools: create module for selecting crypto caller 0c774d5c767 python-common/cryptotools: move internal crypto caller to new file c3dc34a0d55 python-common/cryptotools: add caller module for base class 552d7b4373a python-common/cryptotools: unify and organize all endpoint functions c98e53f1136 python-common/cryptotools: use a main function 4e4cfa58c4b python-common/cryptotools: move actual crypto opts into a class 955143ddfb3 pybind/mgr: fix test case in test_tls.py d2fd81eae98 mgr/dashboard: replace direct use of bcrypt in dashboard 5d4eeff0d5d python-common/cryptotools: give the parsers more sensible names 21d6e1d493d pybind/mgr: Appropriately rename function. e364df39140 python-common/cryptotools: Remove ascii and utf-8 references from encode/decode. 96a7a72cf41 python-common/cryptotools: fix error path in verify tls function 218d84fc15d pybind/mgr: Correct code to ensure cephadm/tests/test_certmgr.py passes. 56d508f9dc1 python-common/cryptotools: Always encode, Err via stderr and signal the exit. 4bcab139830 python-common: Correct typo in private_key naming field. 2b9cf2453f1 pybind/mgr: update mgr_util to use cryptotools CryptoCaller class 9dcfde75e46 python-common: remove unused dir a5861c153e3 python-common/cryptotools: use one single dir for cryptotools 84710f9ed41 python-common/cryptotools: create CrytpoCaller interface class 6f2d92cc6d6 python-common/cryptotools: use json for structured output 717d0a6f353 pybind/mgr: Hack around the 'ImportError: PyO3 modules may only be initialized once per interpreter process' issue. ecbc607d2e7 qa/suites/crimson-rados/singleton: add install task 7ab070413cf rgw: fix aclRequired for bucket-logging 450702a7b9e mgr/smb: Enable per-share profile counters c68175fba57 crimson/CMakeLists: simplify crimson-common deps 1b02531634b doc/README: add Build Types section 50aba695c39 rgw/qa/d3n: improve D3N test robustness 14a11dedc0d Adds a new command-line utility which can check the consistency of objects within an erasure coded pool. A new test-only inject tells the EC backend to return both data and parity shards to the client so that they can be checked for consistency by the new tool. 3b042eb60a5 os/bluestore: Get rid of unused CACHE_BLOB_BL a981b4c0245 rgw/cloud-restore: Update doc with new options added faf06bca959 rgw/restore: Update to neorados FIFO routines b3c867a121a rgw/restore: Use strtoull to read size till 2^64 f00ac7c96f0 rgw/cloud-restore: Fixing issues with initializing and resetting FIFO 9974f51eb61 rgw/cloud-restore: Handle failure with adding restore entry ef96bb0d613 rgw/cloud-restore: Support restoration of objects transitioned to Glacier/Tape endpoint 69369b151b9 blk/kernel: improve DiscardThread life cycle. 675057f4204 mgr/dashboard: Local Storage Class - create and list Fixes: https://tracker.ceph.com/issues/71460 1b83235849f ceph-volume: add seastore OSDs support f2a399b20ac options: fix typos f29e3f307c4 Handle failures in metric parsing 433717a2480 rgw/notifications: allow for graceful shutdown of notification manager 98130068a50 rgw/notifications: replace timer waiter with async waiter 399fc41c686 doc/mgr: edit telemetry.rst 1eff1c1147b doc/rados: remove clonedata command 2dd5edf17ae doc/rgw/logging: fix journal record format 950d911b4b2 mon/MgrStatMonitor.cc: cleanup handle_conf_change 56c753742cb rgw/logging: verify http method exists d9314c53447 CMakeLists: Use target_compile_options for seastar 29b9d1196fd Minor cleanup to ensure make check passes 6c1f4c646cf crimson/os/alienstore/CMakeLists: Cleanup alien::cflags interface b6da1c2c16c crimson/common/smp_helpers: fix missing include 2e121b360c7 mon: Integrate discard queue overflow into pg health warnings f66280bd289 common/options: Added bdev_discard_max_bytes and bdev_debug_discard_sleep options 94168dcd02f blk:Warning added for discard queue overflow 45e5468ea7f doc/radosgw: add rgw_enable_lc_threads & rgw_enable_gc_threads c92be106125 crimson/os/seastore/omap_manager: fix OMapLeafNode rewrite type error 8bcf327c64f common/mutex_debug: fix arm64 SIGBUS/segfault due to data race bfa6edb0ea2 qa/workunits/rados/test.sh: make --serial work with --timeout 0eea3d53ee2 qa/workunits/rados: add ability to run rados workunit locally 26d63d0a1fc qa/workunits/rados/test.sh: Create XML report for timeout tests 91ff6628fff qa/workunits/rados/test.sh: add XML output for neorados tests ec3de752202 qa/workunits/rados/test.sh: add timeout mechanism to RADOS parallel tests 3633bfbb219 mgr/smb: move prune function to be a staging store method ee6b29bb311 mgr/smb: add docstrings to a few staging.py functions f0ffb26b806 mgr/smb: replace cross check if-block with singledispatch 978e92fb68a mgr/smb: move functions from handler.py to staging.py 5db0a0cc759 mgr/smb: extract a cross_check_resource function from handler class 51a098d9ee1 mgr/smb: document ResourceEntry base class methods better c81a666fe07 mgr/smb: reorganize internal.py to use fewer if-isinstance blocks d5fb7f8c2ba mgr/smb: add new ResourceKey protocol class 53a6e4e2ef3 mds: include auth credential in session dump 7e2bd1595d6 doc/radosgw/s3: Document delete-if-unmodified-since 326eef3501c rgw/logging: fix/remove/add bucket logging op names 72482a79667 rgw/logging: refactor canonical_name() ad3f8f81056 rgw/logging: fix canonical names de8c148a2f9 doc/rados/ops: add caps restore command ca2879dae54 crimson/os/seastore/btree: only compile debug-purposed methods in debug builds 52608ba41bd crimson/os/seastore/fixed_kv_btree: remove unused constructors f988f33ec1a mgr/dashboard: Add RGW CRUD topic in dashboard 344cbd54e04 crimson: switch to ceph_abort_msg 77a11a72067 nvmeofgw: fixing GW delete issues 1.fixing the issue when gw is deleted based on invalid subsystem info 2. in function track_deleting_gws: break from loop only if delete was really done 3. fix published rebalance index - publish ana-group instead of index 4. do not dump gw-id string after gw was removed 5382bf2908a .github/workflows/scripts/config-diff-post-comment.js: fix config check ok logic 80c086a7d90 doc/cephfs: add mds_allow_batched_ops to conf ref db5c9dc2e6c mds: nudge log for unstable locks after early_reply 0201f86e693 mds: allow disabling batch ops 73792b78b4b common/options: chomp whitespace e9eedecdc85 rgw/s3: fix PutObject's canned_acl comparisons for BlockPublicAcls 83d89ac9a4c mgr/cephadm: Ceph orch apply command does not give error if 'placement' is passed as both positional and keyword argument bd9d44dd89a osd: Optimised EC should avoid decodes off the end of objects. 7ab0588ad28 osd: During recovery, pass "for_recovery" when attempting re-reads ce5d58d7042 osd: In optimized EC send empty transactions to non-primaries if object is recovering. 1becd2c5f6e osd: Improve backfill in new EC. 8c92dcf6c00 osd: Cope with empty reads from an OSD without panic. 4332a188b72 osd: Recover non-primary shards with the correct version. dafe15ec4d7 osd: Do not do a read-modify-write if op.delete_first is set 2a569d8680f osd: Fix off-by-one error in shard_extent_map. 29039e9441e osd: Invalidate CRC on all slice iterator calls. c2d6414f659 osd: Minor performance improvement in ECUtil.cc 6ab686fefce osd: Use correct shard_versions when queuing multiple writes in optimized EC. 1224063e8f9 osd: clone + delete ops should invalidate source new EC extent cache. 350f3a7a7a8 osd: Make projected_size in ECTransaction const 54a06c97a27 osd: Fix parity updates in truncates. 7fad8b94a75 osd: Fix EC cache invalidation bug b72a13ef1fc osd: Fix panic on fast_read completion in optimised EC 9ff7589c873 osd: Use partial read path for fast_reads 1d7425ef162 osd: Fix access-freed-memory issue in EC extent cache. 6bbc3f9b994 osd: Make EC alignment independent of page size. d17f06b5fcb osd: Fix Truncates in Optimised EC c5f67d37713 osd: Fix written shards policing for multiple loops through generate. 2ead42b8bdf osd: Fix shard ordering bug ca7eebcce7a osd: Remove EC-optimized only flag for not reset_complete_to 8ca209e3370 osd: EC optimizations fix bug when recovering only partial write objects 6c04e4cf2b8 osd: EC optimizations correct pwlc after PG split 20e883fedaf osd: EC optimizations overaggresive check for missing objects 9a4925d1853 qa/workunits/rbd: remove build dependency on ceph-mds 5f687c4a182 osd: EC Optimizations fix proc_master_log handling of splits ddc30625586 osd: EC Optimizations fix missing call to partial_write 7f134a32b38 osd: Do not complete log on non primary until missing recovered. 2e82486884b mgr/dashboard: migrate nvmeof pr #1346 to new cli 652d93acd96 mgr/dashboard: migrate nvmeof pr #1335 to new cli 4713b19f2c4 mgr/dashboard: migrate nvmeof pr #1327 to new cli 9b1a24bf502 mgr/dashboard: migrate nvmeof pr #1233 to new cli a3165e081e7 mgr/dashboard: migrate nvmeof pr #1277 to new cli 9a85c27c374 mgr/dashboard: migrate nvmeof pr #1308 to new cli 4c6304e7ff1 mgr/dashboard: migrate nvmeof pr #1238 to new cli 0c89509e1bb crimson/osd: put PGBackend/RecoveryBackend/PGRecovery and other related classes into the crimson::osd namespace acb0f19c4a5 mgr/dashboard: catch protobuf error due to mismatch in version 84922d1ff0f mgr/dashboard: unpin grpcio deps 6985ed15ce2 mgr/dashboard: sitepackages only for py3 8e6b6cdd5c3 Revert "mgr/dashboard: pin lxml to fix run-dashboard-tox-make-check failure" 8acf8f7e4fe mgr/dashboard: disable saml2 tests when the dep is not there c54eec79962 crimson/os/seastore/FixedKVBtree: return the iterator when removing mapping b257c4cdea5 crimson/os/seastore/FixedKVBtree: introduce partial iterator 715152f49bc crimson/os/seastore/btree: fix indention of handle_merge 85b7a662179 crimson/os/seastore/btree: make "check_split" asynchronous f709800dbd5 crimson/os/seastore/linked_tree_node: add get_parent_node for retrieving accessible parents 11f33e0f0e7 crimson/os/seastore/cache: add maybe_wait_accessible() for lba bottom-up search 224821147f2 rgwlc: fix removal of delete markers (SAL) 753a55d03c3 Allow LC listing order to be a configurable threshold e8cdf948d87 osd/scrub: fixing additional log messages to name pgids cfb66395d6b osdc: remove unused rados.h include from error_code.h 6687c9767d9 doc/rados/configuration: Small improvements in ceph-conf.rst d6c657b7e6b mgr/dashboard: Enable rgw module automatically in the primary and secondary cluster if not enabled during multi-site automation e298be566c4 cmake/modules/FindBoost: add support for Boost 1.88.0 8b3abdd3150 cmake/modules/FindBoost: sync with upstream FindBoost.cmake f0897b4e44a src/common: fix missing return e8dd59354c9 examples/librados: fix memory pointed to by 'rs' is freed twice. a302ae7fe3c cmake: replace WITH_SEASTAR with WITH_CRIMSON 4cb59d6eccd osd: delete duplicate data in enqueue_op() log message 0fcd7677586 doc/mgr/crash.rst: remove outdated module enabling instructions 125557ab040 test/erasure-code: fix stack-use-after-scope by replacing initializer_list with array b4fbabd6fca rbd: add --estimated-size option for import from stdin c91c4928297 ceph.spec.in: conditionalize crimson gts version on el10 a2bc95c9c45 install-deps.sh: add a temporary repo for missing el10 deps 7faa23f160c qa/rgw: fix perl tests missing Amazon::S3 module ffde8d044a2 mgr/dashboard: use system packages when running tox 9551dfa3d5b erasure-code/clay: simplify shared_ptr assignment using reset() d882b8392fd erasure-code/clay: remove unused common/debug.h include 677266c2849 common/plugin: fix spacing in plugin load error message 22aec470066 test/erasure-code: fix memory leak when erasure_code_init() fails e8cde5811f0 osd/scrub: 'starts' messages should name PGs, not shards da4f0cfc18b mon/MgrStatMonitor.cc: cleanup pool_availability 01df0cd84f1 mgr/dashboard: replace usage or progress bar with carbon meter chart a0398200b45 mgr/dashboard update ceph nvmoef proto files c9620d01140 os/bluestore: fix memory leak in HybridAllocator destructor 0a7931f5ab4 qa/tasks/cephadm: override container image tags 54b265f811e osd: EC Optimizations bug fix for flip/flop acting set 912437d4705 osd: Refuse to commit/rollforward beyond end of log. 2467406f3e2 osd: Refactor partial_write to address multiple issues. 6209c8cdf98 osd: nonprimary shards are permitted to have a crt newer than head c8739a2bdb0 osd: overaggressive assert in read_log_and_missing with optimized EC pool 6c8b0297aaa osd: EC optimizations rework for pg_temp 9d9265337a4 osd: EC Optimizations OSDMap::clean_temps preventing change of primary ef0025ab168 osd: EC optimizations bug in OSDMap::clean_temps 95da0cdf96d mon: prime_pg_temp needs to call pgtemp_primaryfirst when encoding pg_temp f66cd3e8600 osd: EC Optimizations fix routing of requests to non-zero shard id 291bece2ff8 osd: fmt::format shard_versions 8ba4c0e6958 osd: Cosmetic code cleanup and improve debug ae85da9ea92 mon/MgrMonitor: add a space before "is already disabled" ea09fd631d5 qa/tasks/cephadm: allow to select from 'cephadm' and 'cephadm.py' f6ad65a9146 rgw/notifications: prevent infinite loop in case of malformed notifications bbab0e6181a rgw/notifications: make queue idle when all notifications are in "sleep" state dd6d4f0bbc9 test/rgw/notifications: prevent client retries to avoid duplicates d732db6e2b6 rgw/notifications: stop processing when we reach a skipped notifications cf1864a6106 osd/scrub: some perf counters priority was '0' 621a80e6f72 rgw: do not include unused header a2e52d3e1b9 pybind: fix callback function type compatibility for GCC 14/15 5f1dc9af57b mgr/dashboard: Fix inline markup warning in API documentation a02cc13191d librbd/migration/QCOWFormat: don't complete read_clusters() inline 9d9c7343534 librbd/migration/QCOWFormat: rename handle_read_cluster() c01eb372326 doc/radosgw: line edit bucket_logging.rst 4461f2362d6 qa: add test_cls_cmpomap.sh to crimson-rados basic tasks 10028897c1d crimson/osd/pg_backend: needn't check if os.exist for omap_get_vals_by_keys 121192f4c95 doc: Document ceph-mgr module configuration options 7f79f3d6aa7 doc: Fix unterminated inline literal in ceph-conf.rst 85b6d55b1f4 doc: do not depend on typed-ast d61f9fffac0 doc/dev/config: Document how to use :confval: directive for config options 2a74ce00809 doc/_ext: Remove unnecessary f-string formatting 84a456bb58f doc/_ext: use raise .. from 29f15aed775 doc/_ext: import status_iterator from sphinx.util.display 7ac59f3a5b4 doc/_ext: do not import unused module b038b8093d0 doc: Fixes a typo in balancer operations bee86373e60 Revert "Merge pull request #64111 from zdover23/wip-doc-2025-06-23-tr71796-rados-ops-balancer" 44dc57fc157 doc/radosgw: remove "pubsub_event_triggered" 5743303ae5c doc/radosgw: add "persistent_topic_len" 9362ecc3640 rbd: fix unused function warning when WITH_KRBD is disabled 978e9c88b5d crimson/common/smp_helpers: cleanup invoke_on_all_seq fdf08aabfff mon/OSDMonitor: call no_reply() on ignored osd alive 6bae0a058ce osd/scrub: Scrub should not expect SS_ATTR on non-primary shards d187babb44c test: Add optional timestamps to ceph_test_rados 80de0a3c92d doc/rados: clarify "upmap_max_deviation" f60065de253 ceph.spec.in: use rpm macro for python shebang pathfix c2895805f02 Fix issue where ceph_test_rados_io_sequence could select a chunksize of 0 which is not valid. 2426c112ae0 os/bluestore: use default value for non-decoded field in test instances 5f96ade1734 doc/radosgw: add "persistent_topic_size" 60797187f33 doc/rados/operations: Actually mention `upmap_max_deviation` setting name c328902e392 doc: Fixed a spelling error. 87d20855809 crimson/common/smp_helpers: cleanup sharded_map_seq 0b686b44260 crimson/common/smp_helpers: rename reactor_map_seq 550b2b8ade7 crimson/common/smp_helpers: fix reactor_map_seq c45e18bd4f4 crimson/osd/shard_services: PerShardState::dump_ops_in_flight debug 69fa3013eff crimson/admin/osd_admin: move to coroutines b90683d3673 crimson/admin/osd_admin: add logs when calling hooks 566a91544d5 crimson/admin/admin_socket: add logs, move to ceph_assert 2ef46b4c832 crimson/admin/osd_admin: DumpInFlightOpsHook to await active f17a6c0e1f0 crimson/os/seastore/lba/btree_lba_manager: never downcast reserved ptrs 8a2e7bfedf2 rgw/notifications: add http request timeout and max inflight 26f2c0ebbe3 doc/radosgw: improve "pubsub_push_pending" info b308f50d1e0 doc/radosgw: remove "pubsub_event_lost" b008ef9eb69 mgr/volumes: Fix json.loads for test on mon caps 403d5411364 mgr/volumes: Add test for mon caps if auth key has remaining mds/osd caps 0882bbe8a44 mgr/volumes: Keep mon caps if auth key has remaining mds/osd caps b76c2b12393 mgr/dashboard: Carbonize Icons for Modules (Block, Object, File, Observability, Administration) ba852da68d4 doc: update user docs and release notes c08cf3277fb qa/standalone/mon/availability.sh: add tests f6aed0b45ef mon: add command osd pool clear-availability-status 7369a4dded2 src/mon/MgrStatMonitor: fix invalid iterator increment in calc_pool_availability() 0bd2704a88f mgr/dashboard: Allow host with labels in listener form 26e7bbf6814 test/librados/aio_cxx: Fix potential mutex destruction failure on PoolEIOFlag ec75b36f9fe crimson/common/fatal_signal: Log error before collecting backtrace 5c738ba6dd6 crimson/common/fatal_signal: skip print_segv_info and proc_maps de2555e45b3 crimson/common/fatal_signal: rework print_backtrace 3c94c1a4c3f cephadm/nvmeof: add DSA acceleration support with conditional mounts and privileges 9977e5c963d monitoring: Add alert NVMeoFHostKeepAliveTimeout 33b33ff1290 script/build-with-container: add rocky10 to built-in distros 7802a61150a script/build-with-container: support --build-arg arguments 9cbadc2e600 Dockerfile.build: make WITH_CRIMSON a build arg ae7878d3c1a install-deps.sh: enable crb for rocky 10 7975c52e81b buildcontainer-setup.sh: allow testing with various ELish bases e5d6aaf97bc common/static_ptr: pass an integer to alignas to fix GCC-11 build failure f80dad2e0ad mgr/dashboard: add a cobertura xml file workaround variable 6f5b23a39ea script/build-with-container: remove unused build arg 37244a7972b release note: add a note that "subvolume info" cmd output can also... 0a029149df8 doc/cephfs: update docs since "subvolume info" cmd output can also... 44cacaf1e46 qa/cephfs: add test to check clone source info's present in... 0ef6da69d99 mgr/vol: show clone source info in "subvolume info" cmd output 17668d5612f mgr/cephadm: add logging to service_discovery condition 393c44fc442 test/mon/test_election: fix memory leaks in Owner and ConnectionTracker f4118f89248 osd/ECExtentCache: eliminate redundant map lookups c9da5b84646 osd/ECExtentCache: convert LRU::Key from class to struct 19b4468c930 osd/ECExtentCache: use default-generated comparison operators 611dee72866 osd/ECExtentCache: Replace manual mutex operations with std::lock_guard aa6ffa5159f client: check if inode ref is dir before proceeding with lookup 23b6b435835 client: do not open dir for a non-dir inode cbf1c5bb39b qa: test unmount hang using high/low level APIs 38912262ad9 doc: Improve central config log documentation f682d62a9d8 mgr/dashboard: add missing ns commands 680b58ffd0b osd/scrub: clarify that osd_scrub_auto_repair_num_errors counts objects eb686df10f1 rgw/multisite: Don't rerun recovery periodically 604d351a4e7 mgr/dashboard: Add --force flag for listeners 784c750df07 test/osd: Make error messages that occur based on configuration problems or user error more readable in ceph_test_rados_io_sequence f6378d56148 ProtocolV2: Revert "make handle_existing_connection check for cookie mismatch first" 60ac642690f test/osd: Add erasure code plugins as a dependancy of ceph_test_rados_io_sequence 0f2103bfb34 qa: drop manual remote snapshotting from the comment fc1532241e4 doc: drop manual remote snapshotting b3187f4fc05 crimson/os/seastore/transaction: stable extent in add_present_to_retired_set() can be pending-io 4ecf0a8d1fc rgw: avoid using std::aligned_storage_t cb680641df3 include/buffer_raw: avoid using std::aligned_storage_t 73399b053fa common/static_ptr: avoid using std::aligned_storage_t ba7b42983cc neorados: avoid using std::aligned_storage_t 5edb4099927 monitor: Enhance historic ops command output and error handling 624cb4ce593 test: multi client file read/write test for extending writes 2b74598afc5 client: do not check file size when inode does not have Fc caps 0c66b1c5b52 common/io_exerciser: fix buffer overread in DataGenerator 7e6021f580b rgw/dedup: full object dedup continued work cca1a17d07f doc/radosgw: update aws specification link 4204f87ba71 .github/workflows/config-diff-post-comments.js: introduce "/config check ok" command e36b43f6447 crimson/os/seastore/cache: fix inappropriate lambda by-reference captures in get_extent_viewable_by_trans() fdba3ddb46d test/crimson/seastore/test_transaction_manager: improve check_available() 36ffa8ca655 test/crimson/gtest_seastar: account test time bb353741a7d test/d4n: Change cleaning interval values to ints e6b59401b95 qa/cephadm/smb: add test using custom ports to run two ctdb clusters f07ae5e31d9 qa/cephadm/smb: add a test that uses custom ports ac213f4704d doc/mgr: document new smb cluster resource option custom_ports 59437707b1f doc/cephadm: document new smb service spec option custom_ports d4e08bf9ede cephadm: don't add --publish options to clustered instances 77b0412e31a mgr/smb: update handler.py to make use of the cluster custom ports value cec3bc6a715 mgr/smb: update the cluster resource with a new custom_ports field e7e13ad1101 mgr/smb: add a test case for custom port validation func 81a5081b7b2 mgr/smb: add validation function for smb cluster custom ports 7122a5198b0 mgr/cephadm: update smb port management in smb.py 3b99fa284d3 pybind/cephadm: update service discovery to use custom smb port 11d4ec2a793 python-common/deployment: add custom port support to smb service spec af82f57389b cephadm: add custom smb port support to smb daemon fa2bc49e2e8 rgw/logging: make unique part of log file both random and incremental f9b84fae92e mgr/dashboard: Tieiring - allow read through 78cf89c21d0 osd: prevent OSDMap::check_health() from asserting due to new OSDs found in subtree cbaadf52191 qa: get_rand_pg_acting_set needs to wait for pool to create PGs e5ea8b0a446 ceph-object-corpus: update submodule 6db984fc0e6 mgr/cephadm/nvmeof: Allow setting NVMEoF gateway read notifications interval in the spec file ae06a93bf18 paxos: use mono clock for latency calculate in latency perfcount e82bf6d0fd8 bluestore: Fix _setattr() with rare memory alignments 04ad137e446 test/store_test.cc: Expanded test for setattr 04324fa1ac1 deb: use variable expansion to support systemd unit dir changes 95101f0c8a9 test/rgw/test_d4n_filter: remove unused captures 8e923953bb3 crimson/os/seastore/transaction: add asserts related to read-set 6bdda0bb341 qa/cephfs: ignore `OSD_DOWN/osds down` warning 3277f0559a1 cmake: suppress -Wmaybe-uninitialized warning in memstore PageSet e663ede232a cmake: build crypto_plugins only when needed for radosgw ba6e10a5af0 cmake: link ceph_test_keyvaluedb directly against kv library 5ab2e9fb531 cmake: modularize os/CMakeLists.txt fb5294abba6 cmake: explicitly link unittest_rocksdb_option against RocksDB f3505203a28 osd/scrubber: replace deprecated fmt::localtime() with localtime_r() 58a51fbb7a0 neorados: Increase timeouts in watch/notify poll tests a329b005795 cls/rbd: use default values for non-decoded fields in test instances d5c7b4d62c7 doc/radosgw/admin.rst: explain bucket and uid flags for bucket quota eaf2a8360d0 qa: fix multi-fs tests in test_mds_metrics.py bd262c3e053 crimson: Use osd_objectstore instead of using crimson_osd_objectstore 448633e325b cmake: use find_program(REQUIRED) to fail early on missing programs d88cdf039d0 doc/cephfs: document first-damage.py 30dc60b8149 doc: mgr/dashboard: add --enable-auth flag 757609f646a mgr/dashboard: bump vite and @angular-devkit/build-angular 1a4c0bc6341 crimson/os/seastore/cache: update extent states after resolving the linked tree 64eaa3ecca3 crimson/os/seastore: fix is_stable_written/writing() and is_stable() 2e9a34eed63 crimson/os/seastore: adjust is_stable_clean() 23edbbd437c crimson/os/seastore: replace has_delta() by is_stable_dirty() 756702b011d crimson/os/seastore: update extent states upon prepare_record() a3a26581d83 crimson/os/seastore/cache: validate extents that skip complete_commit() 0a705115337 pybind/mgr/dashboard: fetch image's mirror mode b3f1d2d183d pybind/mgr/rbd_support: check whether mirroring is enabled 4c992e6c855 librbd/api/Mirror: return EINVAL from image_resync() 8e39f8911c4 cephadm: Fix get_cluster_count when data_dir is missing eb19563c93f librbd/mirror/PromoteRequest: return EINVAL 479014e372a librbd/api/Mirror: return EINVAL from image_get_mode() 4c3e443b732 mgr/dashboard: bump node to 20.18.1 0b6cf66bc0a mgr/dashboard: update npm dependencies 36a2cce433e mgr/dashboard: introduce side panel as a reusable component d4e2d497701 bluestore: Fix _setattr() with rare memory alignments 3c9defab46e test/store_test: Fix BluestorePerPoolOmapFixOnMount 87a73576a51 test/store_test.cc: Add test for setattr 958e6d130cb qa/suites/nvmeof: remove "--refresh" from "ceph orch ps/ls" ce2e2e58b6f qa: archive dmesg logs if nvmeof basic_tests fails c1bc87f71e8 qa: change processing of "nvme list" json output f7dc8c39461 qa: run nvmeof tests against "devel" tag ec3d4fc1cbb qa: reduce nvmeof thrasher fio to 32 devices from 200 ac1547f5877 doc/rados/configuration: Improve ceph-conf.rst 7b631e7a480 mds: generate symlink inode with correct mode 89a25e9fe1d mds/flock: exclude non-persisted fields from ceph_lock_state_t::dump() ad71a82014c cephfs, tools/cephfs_mirror: migrate from boost::variant to std::variant 57322f32ae9 rgw/rgw_file: Move RGW{ListBuckets,Readdir}Request::eof() to .cc file 848abacfc7b pybind/mgr: disable mypy error in diskprediction_local module 4cc89975d76 cls/rgw: remove unused class BucketIndexAioManager 0c4bf860807 cls/lock: add ifdefs for CLS_CLIENT_HIDE_IOCTX 25d3613d42b cls/lock: group overloads by IoCtx vs ObjectOperation 9bc56a05567 rgw/sal: Serializer::unlock() takes optional_yield 2927e89e725 add explicit checksum matrix 54ef383698a rgw: framework shell of gosdk tests 60f9ed8f184 doc: Fix sphinx warnings 9859e8dcfcc osd: Make new EC use non-const iterators 360b079bc5e interval_map: non_const iterator 675b518d59d src: typo in radosgw-admin.cc 6dc77563d4d client: fix memory leak in Client::CRF_iofinish::complete bdf32c4f1f6 doc/cephfs: Improve formatting in mantle.rst c15f7e414d2 doc/cephfs: Update deprecation notice in experimental-features.rst 469d82a1f38 cmake: bump minimum required CMake version to 3.22.1 8886bdd9538 cmake: drop c-ares::c-ares alias 64f590cc8f0 mgr/prometheus: extend tls config to work with Rook orch 91c72367bbf test/fs/CMakeLists.txt: add ceph-common to ceph_test_trim_caps and ceph_test_ino_release_cb 45e0979b60b script/build-with-container: add workarounds for older python versions 3d98e572872 mon: Modified an if statement to check if there were maps to trim a927f6b93e2 osd: Added perf counters for full and incremental maps be1f82f9496 missed internal, apparently invalid no-length exception case 0624dbbc3bd rgw: aws-chunked need not supply any content-length 1bd625a613a rgw_cksum: select checksum algo from only a checksum trailer header 572289a2c7f rgw: recognize checksum from x-amz-checksum-{type} alone f58fa5f4fca rgw: RGWPostBucketLoggingOp uses yield context 608c0de905f src/pybind/mgr/cephadm/service_discovery: fixed HAProxy labels 8f6bcce1676 script/buildcontainer-setup: set WITH_CRIMSON to support crimson builds 7cd048c2ee2 script/build-with-container: handle failure to find source rpm better acebfed03ca script/build-with-container: fix rpm build step when using an overlay da9fca7a108 script/build-with-container: fix rpmbuild when no rpm build args are set e562aa08619 script/build-with-container: cache git branch result 8d0fafa40c1 script/build-with-container: detect when cached build images need rebuilding e5c05e2bbf6 script/build-with-container: add log line with time taken bbacfdae1a2 mgr/vol: keep clone source info even after cloning is finished 9ad5a65fe6c doc/radosgw: edit cloud-transition (1 of x) 7fc79ac7504 mgr/dashboard: Fix capitalization in SMB dc9ee94a8dc qa/standalone/mon/availability.sh: add test for config option 80c7492a808 doc: add docs and update release notes for the new config option d81d2af8fcd mon/MgrStatMonitor: ignore duration for which feature is off c318f80ee2e MgrStatMonitor: add config observer 017c9b9f4fa mon/MgrStatMonitor.cc: do not update score when disabled 9ccef704550 src/common/options: add config option for availability score 425b6dac14d container: update crimson flavors 83d556b85d9 qa/tasks: update crimson flavor types 05fd6f90e6e librbd/cache/pwl: fix memory leak in SyncPoint persist context cleanup 3042c3695cb nvmeofgw: fix sending acks during upgrade fix gw-epoch during upgrade 1.fixed issue when during upgrade before feature NVMEOFHAMAP is applyed, monitor did not send acks to beacon - this cause expiration GW mon-client beacon ack timeout and assert of the GW. 2. fixed issue that during upgrade new GW epoch, generated after applying of new feature NVMEOFHAMAP was less than global epoch. So GW mon-client asserted on receiving new epoch that is less than its last received epoch f350d980002 release note: add note for change in format of name of pool... eb0519b6f88 cephadm: add --dry-run option to cephadm {enter,logs,unit} commands 9149a1eefda cephadm: support --infer-name for cephadm {logs,unit,unit-install} cmds 211e677f1d4 cephadm: support --infer-name option for lazy devs 73bac06cb13 rgw_rest_s3.cc: update how we set bucket quota cfg for max size (bytes) and max objects 6a3fecab1ff rgw/cloud-restore: allow copy of temporary object d3c46820a5f doc/rados/ops: edit cache-tiering.rst 439a8e777f4 doc/radosgw: edit cloud-transition.rst a598c46c505 doc/mgr: edit telemetry.rst f2faf3edb37 os/bluestore: Implemented create-bdev-label f11034b2a22 doc/mgr/telemetry: add doc for telemetry upgrade tests 52b9429fc7a src/vstart.sh: default debug mon = 30 in verbose 78fe8d88e69 qa/suites/rados: debug_mon 30 59f42b0dae8 qa/tasks/mon_thrash: enhanced logging in thrash 2e2c6a1a6fb src/crimson: Improve message 8e6dc02094f monitoring/ceph-mixin/dashboards_out: Correct panel title in ceph-cluster-advanced.json 27042922fb6 mstart: allow setting the base mon port from env variable 343db61578a fix: typo remove whitespace 83345afa898 doc/rbd: add mirroring troubleshooting info e4979709dd0 doc/rados: enhance "pools.rst" c449473c205 test/erasure-code: fix memory leak in ErasureCodePlugin.parity_delta_write c603ce719ac fix: Revert url_decode to old behaviour 660d163271f doc/rados/operations: Address suggestions for stretch-mode.rst bda2ad59aa9 mgr/prometheus: removing call the verify_tls_files d4c6b9c8039 install-deps.sh: refresh package index before installing dependencies 20c4f4f5e5d qa/suties/crimson-rados: Don't override flavor 4587f330e45 doc/mgr: edit telemetry.rst (lines 300-400) fc25b1ed12a doc/mgr: edit telemetry.rst a8348dfc9a6 crimson/os/seastore/async_cleaner: rename min_journal_dirty_bytes c0772d0c0cc mgr: handle possibly undefined template variable in haproxy.cfg.j2 dc835614b7b crimson/os/seastore/async_cleaner: human readable configurations for the trimmer db342778485 crimson/os/seastore/async_cleaner: rename rewrite_backref_bytes_per_cycle to max_backref_bytes_per_cycle cdcce0d374e crimson/os/seastore/async_cleaner: set different threshold for starting and stopping trimming dirty efe4473000e rgw/logging: return the last object name that was actually comitted fb2b037355b rgw/logging: send flushed object name in API reply bac78660c03 test/common: unittest_fault_injector omits unit-main target 32cd4430088 doc/src: edit osd.yaml.in (osd_deep_scrub_interval_cv) 9f554ee8adc mgr/prometheus: improve how we check security configuration status d8adc49fa9d rgw/rgw_lua_utils: fix memory leak in luaL_error() formatting a1f6173cfd0 dmclock: use std::invoke_result instead of std::result_of 2334345baab mclock : Refactor the mClock scheduler source code 9d9adb80db3 .github/workflows/diff-ceph-config.yml: use --ref-commit-sha and --cmp-commit-sha bf2aa9220a1 src/script/config_diff.py: add support for `ref-commit-sha` and `cmp-commit-sha` arguments 37d296b314b .github/workflows/config-diff-post-comment.js: improve handling of GH comment afb52299e36 src/scripts/config-diff.py: simplify sparse_branch_checkout_* functions and add files names to POSIX diff 31d1b53ae42 crimson/common/asserts: Fix formatting a6e2441560f crimson/common/log: add GENERIC_ERROR 35fdacb01b8 include/utime_fmt.h: replace deprecated fmt::localtime() with localtime_r() 0d89cd8d0a7 cmake: enable out-of-source build of breakpad e1c531aa37c qa/rgw: bump maven version in hadoop task to resolve 404 Not Found 7ff53ade38f valgrind: wildcard glibc version for dlopen() leak suppression eee03c25753 valgrind: update rocksdb ObjectLibrary leak suppression for gcc-13 75c94ffc568 rpm: reenable lto for gcc-toolset-13 by requiring 13.3 70b41ea1ee8 src/mgr/ClusterState.cc: micro improve ingest_pgstats bd7440e16ad ProtocolV2.cc: Add more loggings to functions that needs them 5fcbbfb4ccf ProtocolV2: modify handle_existing_connection logic 941c5edac00 mgr: avoid explicitly dropping ref of MgrOpRequest.request 38057ce2c14 osd/scrub: make m_session_started_at at Session state ctor 5377b50a08a mgr/dashboard: fix alignment of log action buttons c7e49b85997 doc/radosgw: edit metrics.rst ac7f757db7b doc/mgr: edit telemetry.rst 97ef126e4b6 doc/mgr: edit telemetry.rst d9d7e73b737 test/test_bluefs: Fixed memleak in shared allocator tests eaed7c05342 os/bluestore/bluefs: Removed unused field from bluefs_super_t 41c7e05be4e test/test_bluefs.cc: Fix valgrind reported memleaks 759fb7f1160 rgw: make jwks url verification configurable 3ce9d033cb6 qa, ec-esb-fio: Add flag for easier replication d27c19bc54a os/bluestore: Debug code to make reshard fail faster ce2d09efebb rgw/logging: log only object ACls in journal mode 3618b1bbbb0 doc/rados/ops: edit cache-tiering.rst b199d75763b doc/mgr: edit telemetry (4 of x) 3ce61e06512 doc/mgr: edit telemetry (3 of x) f8975b05a6c doc/mgr: edit telemetry (2 of x) b3e2ce500f3 doc/mgr: edit telemetry (1 of x) 7722272c350 doc/mgr: edit cli_api 2872986f9a5 doc/glossary: s/OMAP/omap/ 0cde0ef4fdb .gitmodules: remove shallow=true config from nvmeof/gateway 1b9bb174bf9 mgr/dashboard: fix KeyError exception in HardwareService.get_summary() dfbd82f61c4 monitoring/ceph-mixin/dashboards_out: Correct panel title in ceph-cluster-advanced.json a8465ef9a9e cls/CMakeLists.txt: find_package Lua for cls_lua 268966a3644 tools/rbd/action/MirrorPool: remove dead branch 500534382e7 rgw/logging: fix partitioned key format 54f0fe19447 run-make: work around package conflicts from llvm.sh adaab090110 qa/tests: adding back test RgwSiteTest 7510a80d44a rgw/dedup: Bug-Fix Move ceph_pthread_setname() call from main RGW code to the dedup bg-thread 74410e5397e libcephfs: Bump API major version dacabbbc025 .github/workflow: add diff ceph config action a568ae92ea7 script: add config-diff tool 38719245a1c crimson/os/seastore/../btree_omap_manager: workaround log failure b47a9e5f059 test/crimson/../test_transaction_manager: fix try_get_extent() to handle transaction conflicts 8eab80d6fdd crimson/os/seastore/cache: minor cleanups to prepare_record/complete_commit() 513369cd66c crimson/os/seastore: more accurate usages to is_pending() vs is_stable() 6f892feb0c8 crimson/os/seastore: more accurate usages to is_mutable() vs is_data_stable() 6217c2c0bb8 crimson/os/seastore: distinguish between is_mutation_pending() and has_mutation() 8b37bb0e2c7 crimson/os/seastore/../fixed_kv_btree: get_stable_for_key() is called when the node is pending c53b97131ca crimson/os/seastore: cleanup CachedExtent::prior_instance b1704147f81 crimson/os/seastore/cached_extent: drop the unused retired_at 188739f7e92 crimson/os/seastore/cached_extent: merge is_clean() and is_dirty() as has_delta() 9c9e4e61238 crimson/os/seastore/cached_extent: drop CLEAN_PENDING state 30d66ff075c common: drop stack singleton object of temp messenger for foreground ceph daemons 41ecee36cb9 os/bluestore: make vselector reserved* parameters applicable in run-time 03a93dbb181 debian: radosgw: add media-types packages as alternative for mime-support 24771aecdcf doc/start: edit documenting-ceph.rst 85d0d7783bf doc/cephfs: add note about change in format of name of volume pool... 6117c4eff37 doc/mgr/dashboard_plugins: edit feature_toggles.inc.rst 90ac0bdf7d6 doc/radosgw: edit sentence in metrics.rst 7c7633bb679 rgw: allow specifying ssl certificate for radosgw-admin operations e7d6b2783bd cmake: Adjust breakpad builds for newer distros 88cdbc281ea github: add tentacle milestone ad5a42c75ca client: asynchronous fsync can decrement request ref twice 8cf896e382e osd: Access/Modify epoch maps under mutex in OSDSuperblock class 385ebfbff43 mgr/dashboard: bump tar-fs in /src/pybind/mgr/dashboard/frontend a0da7864684 mgr/cephadm: fixing generate_cert to pick the right root subject 201e34119ab doc/rados/operations: Additional improvements to placement-groups.rst 593896de020 qa: Add Teuthology test for BlueStore ESB assertion failure f525ede6bce Add PRE_BUILD (fix for CMake > 3.30) b5bd466cc8d rgw/driver/posix: closedir() to free dir handle f7270c46fb7 mgr/cephadm: include cluster FSID in root CA Common Name (CN) 42b307b9edc mgr/dashboard: Adding RGW Bucket Notification Dashboard for Grafana ddf0cb79e51 doc/rados/operations: Improve placement-groups.rst 37ceacc49a8 doc/mgr: edit progress.rst dd66c9e68b3 doc/start: edit documenting-ceph.rst 26dabda592f doc/dev/cephfs-mirroring: edit file 4 of x a4a29fe23fe doc/mgr: edit nfs.rst 02621f7683b doc/mgr: edit modules.rst e43de826ca5 doc/mgr: edit localpool.rst 7bf5196e703 doc/rados: edit balancer.rst 766a58ce7bc doc/mgr: edit iostat.rst 24acaaf7663 mon/FSCommands: avoid unreachable code triggering compiler warning f4de34f4bdb doc/rados/operations: edit cache-tiering.rst ecba8ecf96a doc/cephadm: edit host-management.rst 406625d7aaf win32_deps_bild: bump openssl version 889655ab777 ceph-backport.sh: update known milestones 2e6108d25d6 rgw/dbstore: free objectmap in DB::Destroy() e00ec10b114 os/bluestore/BlueFS: use nullptr when appropriate a38ff7cb153 crimson/os/seastore/transaction: more logs about inconsistent retired_placeholder e495e0e2c62 crimson/os/seastore/transaction_manager: Cache::retire_absent_extent_addr should be called immediately after TransactionManager::get_extent_if_linked if necessary bfb7bda27e1 crimson/os/seastore/linked_tree_node: rename `BaseChildNode::get_parent_node()` to `BaseChildNode::peek_parent_node()` f6d0bcb4f1a crimson/os/seastore/cache: do seperated add_to_read_set steps for initial pending and stable writing extents 4328521894f crimson/os/seastore/transaction: add interfaces for seperated Transaction::do_add_to_read_set() 755908ecafb test/objectstore: fix memory leak test_bluestore_types.cc 9bdc4e1a028 Improve Catch2 support by adding helper functions. a98d8e6b36c test/common: fix memory leak in librados completion tests 3c21aec85e9 librbd: retry list_snap_orders() once instead of failing sort_snaps() b2bd15b4485 osd/PeeringState: handle race condition of DeferBackfill event for Backfilling state 71799fb6f30 RGW/standalone: Build without RadosStore b6d2724a59d crimson/os/seastore/omap_manager: only mutate the parent when merge/balance can proceed 25301266bbb crimson/os/seastore/omap_manager: add get_balance_pivot_idx to StringKVLeafNodeLayout 33947d54774 crimson/os/seastore/omap_manager: split OMapInnerNode::merge_entry into OMapInnerNode::do_merge and OMapInnerNode::do_balance 57e1408c964 qa: Add snapshot integrity tests 806da643c89 qa: Add yes/no yaml for mds_use_global_snaprealm_seq_for_subvol conf cc09354a49a qa: Add test for mds_use_global_snaprealm_seq_for_subvol config 388c73b0f5e script: ceph-backport.sh adds redmine key to api requests 80b7d6840ca os/bluestore/compression: Fix Estimator::split_and_compress 512f2133bd7 mgr/dashboard: align response of subsystem add and ns add with old cli af8214d46b8 mgr/smb: remove restriction on 1MiB smb config objects in rados 6d6063a9b2b mgr/cephadm: don't remove and deploy new daemon if ports change during upgrade 705857f67fd osd/scrub: only periodic_regular scrubs should extended-sleep e3b83baa0ab qa/crontab/teuthology-cronjobs: Use Crimson falvors fbcdf571ca1 node-proxy: address `ceph orch hardware status` cmd 3eaa3401f6d mgr/dashboard: Creating CephFS dashboard for Grafana f68b2178a24 PrimeryLogPG: don't accept ops with mixed balance_reads and rwordered flags 40292f2fd10 Objecter: remove balance_read and localize_read if rwordered 7a3c6b563bb doc/mgr: Small improvements in rgw.rst 2388ab106df crimson/os/seastore/transaction: turn Transaction::read_set into an intrusive set b35da11bd41 crimson/os/seastore/cache: initial_pending extents also do set_io_wait/complete_io/wait_io f188003530e doc/rados/operations: Add settings advice to balancer.rst 3476b4c69b7 qa/crontab: update priority for tentacle upgrade command 4ead94ee298 qa/tasks: Add a task which performs an offline check of the consistency of parity shards 0d1ba9de151 osd/scrub: no auto-repair in 'after_repair' type of scrubs c22db4e683c mds: fix test that directory has no snaps 659e4262d04 qa: test for child dir with first beyond parent snaps 7678dbfd883 qa: remove extraneous directory from test c428149b9cb qa: correct test description 1510987b860 fix: remove double url_decode from the copy_source and fix url_decode c43ea6253d0 fix:Add empty string check after url_decode 4b6d2000a85 tools/ceph-erasure-code-tool: Fix issue stopping parity shards being generated when running encode. 2519c94153e mgr/dashboard: Show notification for multisite sync status in case there is some error 70f8bdba522 mgr/dashboard: Use a persistent volume to store Loki DB 266d03fca09 common/io_exerciser: Fix the --sequence and --listsequence options for the IO exerciser. Also fix an incorrect read operation in SEQ7. 36569bd2d42 src: fix NDEBUG typo ccb6635922f rgw/logging: add size in MPU complete in standard mode 27698aec2b1 mgr/dashboard: add plain output type support to nvme cli 198fa75258b rgw/logginag: make unique portion of log object name orderd cc876e1a060 qa/suites/crimson: Add a test for PG Splitting in the crimson suite bc91092f070 crimson/osd/osd_operations/pg_advance_map: Use new macro for logging 7c19667d852 crimson/osd/osd_operations/pg_advance_map: Add splitting as a function 7fe1e426663 objecter: request OSDMap after idle ticks 1a2290d85af src/common/options: Clarify scope of scrub intervals in osd.yaml.in 53c3d733683 qa/vstart_runner: Add get_file and write_file equivalents to the LocalRemoteProcess class 5d408439adf doc/radosgw: Small improvements in cloud-restore.rst 4cfc6f105cb Revert PR "mon: Add nvmeof group/gateway name in "ceph -s"" 0e9c69ac899 mgr/dashboard: align cli commands listener list, ns list, host list 443e50af1f3 mgr/dashboard: align gw info, gw version, spdk_log_level get with old cli bd51114ee33 mgr/dashboard: fix set spdk log level cli command be67afcfcb5 doc/mgr: edit telemetry.rst 1da17287279 doc/mgr: edit telegraf.rst 82a4b46d17b doc/mgr: edit smb.rst e7f2a4b5b22 doc/mgr: edit rgw.rst 7cae041f46b doc/mgr: edit prometheus.rst 9bada3be2f4 doc/mgr: edit progress.rst 31ce3058fbc doc/mgr: edit orchestrator.rst 2c3815aadb4 doc/rados: improve markup in cache-tiering.rst bd4e8d8f03a doc/cephfs: correct ill-formatted command 50dc9f1a04c doc/rados: s/enpty/empty/ in pgcalc doc 16ad8131f09 rgw/d3n: fix teuthology run-datacache.sh FAIL when stripe_size!=4MiB a4732b12f3c crimson/osd: fix print format error 135c0356021 crimson/os/seastore: increase OI_MAX_LENGTH to avoid storing OI data in the omap tree 895121fb3d3 test/rgw/dedup: add dedup test suite to teuthology 1c2544d8e1d doc/mgr: edit nfs.rst 1818e48abbb doc/mgr: edit modules.rst. 9a2d281886f crimson/os/seastore/omap_manager: handle the cases in which omap nodes are rewritten before seen by users 8b42c182ed8 doc/radosgw: Fix capitalization, tab use, punctuation in two files 863d57de735 doc/radosgw: Cosmetic improvements in cloud-transition.rst e10903915d6 doc/radosgw: Cosmetic improvements and ref links in account.rst fc57ec7a102 rgw/sts: removing default value of rgw sts key and adding checks to return error when it is not set in config options. 27f9c103f1a rgw: make sure max_objs_per_shard is appropriate in debugging scenarios 2e921b9576d doc/releases: add release note about OpenSSL version 8dbe7117b65 rgw/logging: part upload operation name should be REST.PUT.PART 1e117ce6e29 rgw/logging: extract tenant from bucket name on admin flush 9e4d95147c2 doc/cephadm: fix upgrade ordering aa379710639 cephadm: add optional build flag 3a36180a373 dashboard: fix the workaround for unpacking node sources 081bda7e97d rgw/dedup: full object dedup f2b292f522f test/rgw: link lua test against unit-main for g_ceph_context bf8b23bfde7 mon: s/assert/ceph_assert/g' c3c9e5ebad2 qa/rados: Fix problem with recompression failing osd bench tesing 94016c7786f rgw/logging: support object metadata changes in journal mode 81e09bee540 rgw/logging: add mtime to get-bucket-logging response 149084fc501 crimson/os/seastore: prevent incorrect space calculation at maximum capacity efc438bd9f5 doc/mgr: edit mds_autoscaler.rst 9e7246b7407 doc/mgr: edit localpool.rst 98708a7f7f3 doc/mgr: edit iostat.rst 31d7dac8ff6 doc/mgr: edit insights.rst 32bdcaab3c4 doc/mgr: edit influx.rst. 6abbcf6038a crimson/osd/shard_services: make use of PGCreationBlockingEvent 53643fd16f3 crimson/osd/shard_services: Remove implicit capture of this 7124a44d84d crimson/osd/shard_services: Add function create_split_pg_mapping for PG splitting 2f4197e31e2 mon/OSDMonitor: Remove check for FLAG_NOPGCHANGE for crimson pools 8199ece3e7c crimson/osd/pg: Add helper functions for PG splitting in Crimson b862e39a8b0 mgr/nfs: Add Spec parameter for ganesha.conf Bind_addr Fixes: https://tracker.ceph.com/issues/71031 f9ba2e9d5f8 cephadm: Provide appropriate exit codes for orch operations 5478fb94a3d make-debs.sh: Optionally rm version from build dir 3b2064e7066 qa/rbd/iscsi: ignore MON_DOWN warning in logs 6389ff4bcb6 doc/rgw: use 'confval' directive to render sts config options 74288183964 mgr/smb: Add new configs to share definition e70d9328fc7 rgw: move rados-specific parts of RGWRealmWatcher into ConfigStore cb91678ab09 qa/standalone/scrub: extra delay in osd-scrub-test.sh 8661509c164 doc/mgr: edit motd.inc.rst a9f591f4e1c os/bluestore: rename row names in RocksDBBlueFSVolumeSelector. 7b30aeb267c mgr/dashboard: Fix applicatin pool table for filtered pools 2a1558a543b doc/cephfs: Cosmetic changes and small fixes in cephfs-mirroring.rst d2f5c3b7edb mgr/dashboard: Allow the user to re-use existing r ealm/zg/zone and setup replication dadc7f40d04 msg/async/Event: use eventfd on Linux 70afb7bdd32 mgr/nfs: Add Monitoring_Addr parameter to ganesha.conf 64db0454afb mgr/dashboard: scroll up by default when clicking on side navigation 948e0426b35 osd: move load avg units conversion to the client 162baba744c osd/scrub: remove OsdScrub::LoadTracker 22200d6cdf5 doc: address review comments 22025a6a75e os: s/assert/ceph_assert/g' f0028be0ec5 osd: s/assert/ceph_assert/g' fc8c8e6e3ae crimson/os/seastore/FixedKVBtree: correct MAX_DEPTH 725ec09ee5e crimson/os/seastore/FixedKVBtree: remove with_btree_ret helper function 4593e5177d2 crimson/os/seastore/lba: flatten lba namespace to keep consistent with backref dca4e562f2d crimson/os/seastore/BtreeLBAManager: support refresh LBAMapping f2a804b64f9 crimson/os/seastore: simplify the processing of indirect LBAMapping 9c8e0a06349 crimson/os/seastore: fix LBAMapping/BackrefMapping usages 32a8cf134df crimson/os/seastore/BackrefManager: adpat new BackrefMapping d143fa7bb09 crimson/os/seastore/BtreeLBAManager: cleanup the impl of alloc mapping and remap 98df29eea1a crimson/os/seastore/BtreeLBAManager: refactor update_mapping_ret_bare_t 0751f1a64a4 crimson/os/seastore/BtreeLBAManager: refactor with LBACursorRef 1ab74cd5110 crimson/os/seastore/BtreeLBAManager: split _alloc_extents implementation 20f2ed8a72e crimson/os/seastore/BtreeLBAManager: cleanup alloc_mapping_info_t 14afe98f735 crimson/os/seastore: rename type remap_entry to remap_entry_t 23883c91d5f crimson/os/seastore: refactor LBAMapping and BackrefMapping 84cb3d8ae44 crimson/os/seastore/FixedKVBtree: return BtreeCursor instead of BtreeMapping 972c139e9c5 crimson/os/seastore/btree: introduce BtreeCursor 8c6d82e0c7d crimson/os/seastore/btree: move lba/backref_map_val_t to the common header file fa6ed28edde crimson/os/seastore: remove child_pos in LBAMapping 3c4d047e1ed crimson/os/seastore: remove PhysicalNodeMapping and BtreeNodeMapping 54476e829fb crimson/os/seastore: move BtreeNodeMapping::is_viewable_by_trans to CachedExtent 796b1ec43e7 crimson/os/seastore/btree: remove the unused template argument of op_context_t 6ef9ee1697d crimson/os/seastore/FixedKVBtree: use min_max_t<>::min to build begin iterator 87a375c20fc doc/mgr: edit hello.rst 4d628d93ce7 doc/mgr: edit diskpredictor.rst 18e4ca25819 doc/mgr: edit feature_toggles.inc.rst 1e87aa66b9d doc/mgr: edit debug.inc.rst 2619f011f1e mon/MonMap: remove redundant method 2fe93953149 github: add rgw label for changes in doc/radosgw 158d1550a02 test/bluestore: add volume selector tests 43d7864093f os/bluestore:fix bluestore_volume_selection_reserved_factor usage 76a7c2c8078 doc: Revert "Merge pull request #63351 from anthonyeleven/document_HTTP_X_AMZ_DELETE_IF_UNMODIFIED_SINCE" defe3ed6176 qa/crontab: run Crimson nightly 31fae3a9013 rgw/d3n: fix valgrind invalid read during exit 3381041d190 doc/radosgw/s3: Document delete-if-unmodified-since d0a142a1e15 src/CMakeLists: enable libhwloc 05eb2b3660b crimson/os/seastore/btree: remove unused methods c7667ea45a4 crimson/os/seastore/omap_manager: limit the max size of kv inserted to the omap tree c90d7aeb30b crimson/os/seastore: adjust and fix rebalance logic in lba/backref/omap tree 3572da72441 qa/cephfs: replace deprecated assertEquals with assertEqual 7f1f3f11f88 vstart: support --crimson-poll-mode 1ce14265d7b common/options/crimson: introduce crimson_poll_mode 5e1b3cd566f doc: Fix missing blank line Sphinx warnings f2dcff07489 doc/man: Fix inline formatting in ceph-bluestore-tool.rst b8d2c6832fb osd/PeeringState: re-evaluate full OSDs while waiting for recovery reservation f36746c2a47 doc/cephadm: Fix automodule generation in certmgr.rst 15935db5d78 doc: Use existing labels and ref for hyperlinks in architecture.rst 2962b4c0261 mgr/dashboard: add missing fields to subsytem list command 3392bc0f506 osd/scrub: minimize calls to sysconf() in scrub_load_below_threshold() 4a0d5ea20ac osd/scrub: remove the 2'nd option for determining 'low load' for scrubbing 9363ed6e574 tools/ceph_dedup: Add const qualifiers and reference parameters 10938b6521b tools/ceph_dedup: Replace iterator loops with range-based loops 083d2a14f5d mgr/dashboard: accept dot(.) in user_id & (alphanumeric chars, _) in tenant in user form 57cbc9b6599 rgw/qa: Move admin pagination tests 6b7df5f9597 doc/rados/configuration: Fix invalid hyperlinks in mclock-config-ref.rst 34800363f86 doc/radosgw: Fix indentation in cloud-transition.rst 0dc5f4632cb doc/rados/operations: Fix unordered list in health-checks.rst 14fa086a8ce doc/rados/operations: Fix invalid hyperlink in crush-map-edits.rst 69d47b11bd4 doc/cephfs: specify mount path in example command 2524bbfe1ac tools/ceph_dedup: add modelines for emacs and vim dbb409e21b9 rgw/multisite: change HTTP error handling from EIO to ERR_INTERNAL_ERROR 1f587883a67 doc/mgr: edit dashboard.rst b762e98a4db osd: Correct scrub analysis for OSDs and fix up written shards. da8f614180f common: fix backtrace leak in __ceph_abort and friends 5798d2fc9a5 mgr/dashboard: fix flaky promql query test 50e9dede589 crimson/os/seastore/linked_tree_node: correct balance pivots calculation for both fixed-kv tree and omap tree e296c756ca1 doc/radosgw: Use ref for hyperlinking to multisite 7c5db3e6dd3 test/test_not_before_queue: Fix memory leak by freeing ineligible items in destructor cbb9ab7716a doc/radosgw: Cosmetic improvements in dynamicresharding.rst cae4231cb53 doc: address review comments a2937fab78e doc: address review comments 9665b2072a6 doc/rados/operations.rst: add docs for availability score db8c3f99f97 qa/cephfs: test that group name is included in pool namespace name 94ab44caf5a qa/cephfs: minor improvement for a helper method 45f8abab8f4 mgr/vol: include group name in subvolume's pool namespace name b5e37cf636a doc: quincy 17.2.9 release notes 49eff343d55 doc: 17.2.9 Release Notes with CERN el8 builds 0ea8570f967 mds: use available CInode* for uninline data ddb86b7d87b Revert "mgr/volumes: handle bad arguments during subvolume create" 88f2269ca7f qa/suites/crimson-rados:Seastore (recovery) thrash tests 3915238f21c doc/dev/cephfs-mirroring: edit file 3 of x 8028438af0e qa/suites: wait longer before stopping OSDs with valgrind e9a27051a7c doc/dev/cephfs-mirroring: edit file 1 of x c6ac71d398c test/libcephfs: copy DT_NEEDED entries from input libraries 600584f749e test/fs: only add libcephfs as library dependency 9d22425c55a test/client: do not depend on libcephfs 51d447b7748 Externalize Keystone secret key cache TTL 26fdfbb9171 qa/tasks: generalize stuck pg ignorelist entry bd034ae1db3 doc: quincy 17.2.9 release notes 17805489404 rgw/zone: remove duplicated startup logic in RGWSI_Zone d2467bac505 test: Breakpad Death Tests 92e115f9c5c cmake: Disable incompatible warning flags for Breakpad cf7d43aec7a global: Make breakpad code compile-time conditional on HAVE_BREAKPAD a451047c17c cmake: Make breakpad build conditional (WITH_BREAKPAD) 5729a4b928f global: set up breakpad crash reporting 827de0d47a7 rgw: set umask for luarocks temporary directory a5dc676c2dd mgr/dashboard: Add application overview page to grafana 5fbb9c5e464 msg: drain stack before stopping processors to avoid shutdown hang aa3ff63b6fa qa/suites/crimson-rados: disable chance_trim_stale_osdmaps 0768ef3fcab doc/dev/cephfs-mirroring: edit file 2 of x aa2d9f98676 doc/mgr: edit crash.rst 2c76845a210 doc/cephfs: correct reference structure in fs-volumes.rst b7889dc4f08 doc/monitoring: correct list formatting e81cf376ac3 doc/mgr/dashboard: s/promt/prompt/ in dashboard.rst. 9738b8d3627 qa: fix test_cephfs_mirror_stats failure 133cdb7798f qa: setup_mount_b in test_mirroring.py 87ff77183d8 mgr/dashboard: Fix delete listener 9a7c907bfc2 mgr/dashboard: Add default state when gateway groups are empty aa0f7a6724b qa: Add "osds down" in log-ignorelist to avoid the test case failure during upgrade 8280d334b9b doc: fix formatting in cephfs_mirror dev doc 548ee41a0ab crimson/osd/../client_request: add logs around get_obc stage a2121ebbc8a crimson/osd/pg: set log_entry_update_waiting_on prior to sending requests 5f34af44b9d qa/tests: skipping test_cephfs_clients_get_after_mds_down in test_cephfs 48446ab5cc8 libcephfs: increment library minor version c51c9a89598 test: add test to fetch perf counters via libcephfs API 259967e7b74 libcephfs: add API to get client perf counters 00ff16cb5e9 client: fix total write operations perf counter name 25fa4218f62 mgr/dashboard: deprecate `transifex-i18ntool` and support transifex cli aa2e91ff70e doc/radosgw: Cosmetic and formatting improvements in vault.rst 4ed4bdcc383 script: ignore main branch when cleaning ci 8d99563fffd qa/standalone/scrub: no 'deadline' checks in osd-scrub-test.sh 5f83bde31eb osd/scrub: remove the 'deadline' attribute from the scrub job 4e6323f894f osd/scrub: remove the deep-scrubs deadline attribute 06813101065 mds: log meaningful error message when entering damaged state c95509edcdf crimson/osd/pg_recovery: only reset_pglog_based_recovery_op if complete c0e979180de cmake: build and link breakpad e1bde029487 submodule: Add breakpad, linux-syscall-support (dep) 9781e36073e tools/ceph_dedup: remove 'using namespace std' 92e41e086a5 cephfs, tools/cephfs_mirror: migrate from boost::variant to std::variant 51bee7a9369 doc: add release notes for availability score 1cebd41369b mds: Don't use global snaprealm seq for subvolumes d6254a3c64b mds: Fix mds crash while removing ceph.dir.subvolume 3d5dd123531 qa: Add 'ceph.dir.subvolume' removal test 83611c88320 doc/radosgw: Use ref for hyperlinks, 1st batch d203e556457 doc/radosgw: Use ref for hyperlink in archive-sync-module.rst 6e836f8f1e1 doc/radosgw: Improve rgw-cache.rst 2ae483840ae doc/mgr: edit cli_api.rst 9d7ae6012c0 tools/cephfs/first-damage: default conf if CEPH_CONF not set 7eaa56b0657 tools/contrib: remove balance_cpu and helpers 1795f46ebbc vstart.sh: simplify crimson core assignment, use assign_crimson_cores.py ab566d54a82 qa/cephfs: increase data to be delay data sync by mirror daemon 19802bab6f5 cephfs-mirror: integrate blockdiff API for regular file transfers ae9b0350e64 mds: dout snapdiff snapid's before validation check d9ac4315154 cephfs-mirror: current sync mechanism uses sync mechanism subclass'ing 830626bbebf qa: add test for syncing already existing snapshots 23e4cd57567 cephfs_mirror: avoid latest changes on the source fs to enable mirroring 16918487d6c mds: introduce BLOCKDIFF feature bit fb1b72d5cbf client: disallow unprivileged users to escalate root privileges 7d4dfdbe990 build: Modify rocksdb submodule 988c668775e crimson: bump seastore_max_concurrent_transactions size from 8->128, clarify description 1824937803a crimson: bump lru size from 64M->1G, clarify description f6a569b9267 os/bluestore/bluefs: Fix bluefs_fnode_t::seek ef30b1d393f test/objectstore/unittest_bluefs: Add test for envelope more recovery 61673450ac6 doc/rados/operations/pools.rst: changes to scrub parameters f6bc2ecd6ed osd: Check OI version against reference in scrub if not expected to exactly match. 27521bf5580 .github: Fix RTD build retrigger 170e9f75fd7 osd/scrub: fix deadline calculations 742659b18a2 doc/mgr/smb: document the 'provider' option for smb share 2e6ef874026 common/version: --version to output BUILD_TYPE fc7597df316 do_cmake.sh: update build type warning c5766bb2c48 CMakeLists: Fallback to RelWithDebInfo 13a9c77e47c ceph.spec.in: build with fuse 3 3e700664142 qa/cephfs: use "snapshot getpath" cmd instead of constructing... 8cecbc26c44 qa/cephfs: add tests for "snapshot getpath" cmd against v1 and... 29f0f2914ef mgr/dashboard: fix make check tests 07319d9a37e test/librados/aio_cxx: skip EIO boundary assertion when no in-flight I/Os 268cd91fd65 qa: enable libcephfs debug logs for fio workload with nfs e55730c0736 mon: fix duplicated entity addr in the map during reboot of several nvvmeof GWs c1daf8534bb Fixes:https://tracker.ceph.com/issues/71248 db28c1f32ff doc/mgr: edit alerts.rst 5c17f224231 doc/mgr/ceph_api: edit index.rst cf374b677f2 do_cmake.sh: remove --progress, it's just noise 1479e11c30b qa/tests: skip rgw site tests in api bbc9e961e90 os/bluestore/recompression: Estimator omits large compressed blobs d3009d41bf9 rgw: introduce rgw_bucket_eexist_override 16102c69270 mon: increase dns buffer size d2699c4bcad client: clamp sizes to INT_MAX in sync i/o code paths f4f359e5bde client: restrict bufferlist to total write size 7c487c36ae0 mgr/dashboard: fix some linting issues. Fixes: https://tracker.ceph.com/issues/66995 Signed-off-by: Ankit Kumar <51ankitkp@gmail.com> 3366ef5153f PyModule: Fix memory leak in load 0da7a2a58c2 os/bluestore: In BlueFS::truncate accept wierd alloc_unit c1614fe7b89 PyModule: Fix memory leak in load_subclass_of 6a4215a62ac doc/rgw/lua: add info on luarocks package acfe527d9bb os/bluestore/recompression: Now able to reach left boundary 7e92fd14609 doc/radosgw: Cosmetic and formatting improvements in frontends.rst 786ea203a28 librbd, tools: migrate from boost::variant to std::variant 12154f287eb rgw/rgw_rest: determine the domain uri prefix by rgw_transport_is_secure efd4aa955c3 tools/contrib: add assign_crimson_cores as a more general replacement for balance_cpu d27f0bd89a9 doc/releases: format bullet points 0e1adc4ae69 doc/cephadm: Correct formatting in upgrade.rst 9e39e5c2de0 qa/cephfs: add a helper method to construct the snapshot path c1761436d1a qa/cephfs: move tests for "snapshot getpath" cmd to a separate class fab2cbd72b6 script/backport-create-issue: fix the syntax warning a8498ddad53 mgr/cephadm: fix custom alertmanager webhooks 42c07e93a98 mgr/rgw: don't fail realm bootstrap if system user exists already 61e2b24b467 mgr/rgw: include message field in reported errors dd7d1196af1 mgr/cephadm: disallow changing OSD service type to non-OSD types 9075b17b5a9 Update install.rst to point to ~ instead of /home/ 94dbc49e2b1 cephadm: don't collect image ids for daemons with no container info 7fa025e08a2 rgw/doc: Add doc for admin bucket list pagination 1d5523ec0be rgw/admin: Add max-entries and marker to bucket list 332b0366088 qa/tests: added "tentacle" option 314d2e7dddc crimson/osd: Logging fixes c94e604bbb6 crimson/osd/pg: Let PGListener use start_peering_event_operation 798a14a0f7c crimson/osd: Convert do_recovery() from bool to stop_iteration ce4e9aaad8f crimson/osd/pg_recovery: rewrite start_recovery_ops 278293b3389 mgr/vol: log in case path goes in missing in async_cloner.py 359277bc532 mgr/vol: handle case where path goes missing for a clone 5a3a4f73476 osd/scrub: check all(*) conditions in restrictions_on_scrubbing() e4b947a4e8a doc/script/gen_state_diagram.py: adapt for crimson BackfillMachine 13255857a3f doc: Add branch protection step to new release checklist 24dbfb5da48 dashboard: ensure nodeenv downloaded content is owned by current user 12664b615ed Add support for Catch2 2f3ffff3476 crushtool: init with CINIT_FLAG_NO_DAEMON_ACTIONS 8f2dd0dd9be rgw: call read_op::prepare() in get_obj_policy_from_attr. bcc695b8892 RGW - Set the mtime on ReadOp in RadosStore 6db5a934b9e qa/multisite: add object tagging tests to multisite suite 6b22643658f doc: reef 18.2.7 release notes 1cf203c350d doc/cephfs: add snapshot name note b8079bd48b2 RGW - zipper - Set the instance in get_obj_attrs() f30a6a8f726 RGW - zipper - Remove target from get_obj_attrs() 30411f3f97c doc/src/common/options: mgr.yaml.in edit 859950180f0 doc/mgr: edit administrator.rst 63233196aee mgr/dashboard: remove map_collection decorator and adapt host list nvme endpoint f0462af62f3 doc/radosgw: Use Title Case consistently in index.rst ede013f4adc rgw-admin: report correct error code for non-existent bucket on deletion db7722e7778 doc/radosgw: Improve language, capitalization and use config database b2473066543 rgw/frontend: Allow multiple rgw's to run on same port on same host. 6dae0fb9d15 doc/radosgw: Language and use inline code for labels in metrics.rst 4ebd027cfe2 osd/scrub: making Scrub's fadvide flags a constant 1481e8ca9dd kv/rocksdb: raise rocksdb get latency perf counter 993541cf402 doc/radosgw: Use Ceph Object Gateway as term in metrics.rst 64bb1cffe3d doc/cephadm: correct markup in rgw.rst 899da82ae2e doc/rados: Update mClock doc on steps to override OSD IOPS capacity config 25a8de9c3db rbd: write image mirror status if state is CREATING 78d0bab8d6f orch/module: alias unpause command with orch resume b5e01424a51 rgw: check all JWKS for STS 46c52391928 qa/crontab: add tentacle nightlies f8a44d9fa4c test/rgw/multisite: test error handling of forwarded s3:PutBucketPolicy 3e9faa4de0d test/rgw/multisite: test error handling of forwarded iam:DeleteRole d80cacab5d9 rgw/multisite: forward_iam_request_to_master() preserves ErrorResponse responses 637bdd7ca5f rgw/multisite: rgw_forward_request_to_master() preserves Error responses 36583eb9bdf rgw/rest: RGWRESTConn::forward() prefers to return http errors 46d6f817e81 rgw: remove unused RGWObjVersionTracker from RGWDeleteBucket 0de42922297 rgw/rest: removed unused 'objv' from RGWRESTConn::forward() 0f1f6ed29a9 qa/rgw/upgrade: add upgrade from tentacle f9eced0ba75 qa/rgw/upgrade: add upgrade from squid be7d00935e9 qa/rgw/upgrade: remove upgrade from reef 01d2ff3fb0d qa/rgw/upgrade: remove upgrade from quincy b22990333b5 RGW/standalone: refactoring issues for ConfigStore and rgw_zone 055048b4d31 RGW/standalone: fixed jenkins issues 263264ae76f RGW/standalone: fixed teuthology issues 9342ae64976 RGW/standalone: fixed issues emerged when testing mulsite f2bdd9a0b48 RGW/standalone: fix issue emerged when vstart-ing cluster 9efbe5db229 RGW/standalone: removed RGWSystemMetaObj from rgw_zone 8eb3c26b087 RGW/standalone: refactor RGWZoneParams with configstore 4bb08c92479 RGW/standalone: refactor RGWZoneGroup with configstore 09383ab42ba RGW/standalone: review fixes 8ab3694b214 RGW/standalone: refactor RGWRealm with configstore de9073218ee RGW/standalone: refactor RGWPeriodConfig with configstore 976889ff3ac RGW/standalone: refactor RGWPeriod with configstore 2848bc8ce33 crimson/osd/recovery_backend: scan_for_backfill_primary correctly handle missing object 74644aa8847 include/any.h: avoid using std::aligned_storage_t 0e190b84a13 doc/radosgw: Promptify cmds and improve formatting in placement.rst 00a1da1d0c0 doc/radosgw: Remove stray full stop mid-sentence in compression.rst 86a821a036c doc/radosgw: Use privileged prompt for CLI commands in admin.rst 8649bc097ac doc/radosgw: Improve formatting in d3n_datacache.rst 4816832555d qa/standalone/scrub: fix expected output in snaps repair tests 0c15eb5ca59 crimson: add operation wrapper for MOSDRepOpReply b031373de33 crimson: convert cross-core operations to use RemoteOperation 794bb024efa crimson: fix DynamicPerfStats usage in ClientRequest 6da6b0f83cb crimson/.../osd_operation.h: add RemoteOperation 607c773db36 crimson/.../osd.cc: convert active ops to start_pg_operation_active 1a75da4b0d2 crimson/.../pg_shard_manager: add start_pg_operation_active 995dc6284ea rgw: utilize is_impersonating for forwarded sts requests 4d59bb6c579 .github: run verify-qa from base branch 6ac87294744 .github: run verify-qa when PR HEAD is updated 004ccc7a987 rgw: dont rate limit forwarded requests cc033cb16ff rgw: use is_admin() for permission checks 97b4b608fba rgw: override perms for admin on data sync 1a253ea065a rgw: change is_admin_of() to is_admin() c8aca216f7d rgw: make rgw_sync_pipe_params::user optional 9523e15fb74 qa/rgw: add perm check test for copy obj between zonegroups 8c15d4674f5 doc: add release note for new policy actions on replication 3c83520d333 rgw: remote copy obj pass rgwx-perm-check-uid for perm evaluation 926ed16c27c rgw: RGWRadosPutObj evals source bucket perm for backward compatibility b0200c627b1 rgw: make verify_bucket_permission functions const 84a8d1ba0ed rgw: give hint via header for perm evaluation in GetObj 0a93e74a047 rgw: rest client callback when all headers are passed 86aa6d36e24 rgw: pass rgwx-perm-check-uid for multisite fetch object 3024b70ad56 rgw: GetObject(Version) not allowed to replicate sse-kms objects ae8d7a97714 rgw: take account GetObject(Version)Tagging when replicating e4f44851b3c qa/rgw: add test for source object perm check in multisite 4fde9dddb8c rgw: replication require lock perm if enabled 89d92dee29a rgw: check source object replication by replication actions f2ba4db7b2e rgw: export action_bit_string through header file 2a0cb65076f rgw: only allow system override if identity is not impersonating 0e650ea2766 rgw: SysReqApplier overrides is_admin_of based on impersonation 3f2514f7cf2 qa/rgw: add test for new replication actions 3fb1671520d rgw: support s3ReplicateTags perm on destination bucket for replication 97ee3287fb3 rgw: check for s3ReplicateObject perm on destination bucket for replication d7fe7915b45 rgw: verify perm on delete replication 857f7bd8e6b rgw: move RGWUserPermHandler to header 77c9304102e rgw: weaning off RGWUserPermHandler from RGWDataSyncEnv e7422956988 rgw: send bucket sync structs to bucket_sync.h bb337be0846 rgw: drop unused params passed to RGWStatRemoteObjCR by RGWObjFetchCR 139967011d9 qa/standalone/scrub: fix expected output in replicated repair tests a7fa91aebde doc/radosgw/compression: separate RGW and RADOS pool level compression 3aceb1fd448 qa/standalone/scrub: fix expected output in EC repair tests 78d9ec49aa2 doc/radosgw: Improve formatting in bucketpolicy.rst 5bfd0b7100d rgw/d3n: store cached objects using hash digest a8f18e319cc doc/radosgw: Use macro for release info in bucketpolicy.rst 70ac8a8d5a3 test/libcephfs: Add a new test with ceph_ll_get() API 04c81a4cf01 libcephfs: Implement ceph_ll_get() API 718fe447865 doc/radosgw: Promptify CLI commands in compression.rst 070ecba9fdf doc/radosgw: Promptify commands and improve formatting in keystone.rst 315fb962435 ceph-volume: Fix splitting with too many parts 6783245e98b doc/radosgw: Promptify CLI commands and fix formatting in layout.rst b521e969b94 pybind/mgr: Fix missing empty lines in mgr_module.py d8141f4302a mgr: migrate from boost::variant to std::variant 435f065a13c crimson: Create the shared promise before waited upon 07ac4c3f8b7 common: avoid using std::aligned_storage_t 855db87f4ad rgw/qa: added test case to assume a role after role creation syncs, and then creating a bucket on both primary and secondary. The test name is test_assume_role_after_sync. 63bc73802dd rgw/sts: by-passing authentication using temp creds in case the request is forwarded from secondary in a multi-site setup. authenticating with the system user creds of which are used to sign the request. Permissions are still derived from the role. b7fca3676ee osd/scrub: always round up reported scrub duration b5bbeb7ea3a rgw/sts: Use client_id for assumerolewithwebidentityresponse if aud is not present in JWT. d970f62e3e2 rgw/sts: adding validation of jwks_uri cert according to https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_providers_create_oidc_verify-thumbprint.html for n&e which can be later used for all key types (x5c, n&e). 4c08b48a655 rgw/sts: fix to pick jwk which is of type 'sig' for signature validation of the token. b368cab8064 rgw/sts: adding code for JWT signature validation using modulus and exponent for RSA group of algorithms. b4fb5dc4030 doc/radosgw: Fix RST syntax rendeded as text in oidc.rst 66fa225bdbd doc/radosgw: Fix length of section header underlines in oidc.rst a7dcc3cf242 doc/radosgw: Improve formatting in layout.rst 1fc9c44307a pybind/mgr/volumes: make casesensitive attr uniform in interface 358e6e86372 qa: add test for cloning with charmap 63b95c3ee9a pybind/mgr/volumes: fix typo in casesensitive vxattr f3cc52124c6 rgw/lc: stop using merge_and_store_attrs in remove_bucket_config c8c6bee3cf4 mgr/dashboard: Update translations bb8f0ce3bf5 mgr/dashboard: Replace `data-cy` to `data-testid` 40a9bbb3297 mgr/cephadm: block deploying nvmeof daemons on the same host 8af8f7066fc libcephfs_proxy: remove arithmetic on void* 73dadbd269b monitoring: Fix NVMeoF subsys/namespace limit alerts 01cf6db70ac os/bluestore: introduce allocator lookup policy 71ce48752f1 os/bluestore: add free space spatial histogram to adminsock ee388c3e426 crimson/os/seastore/cache/LRU: account the empty extent when adding it to LRU ec8ae45ad4d doc/radosgw: Fix section header level in config-ref.rst ee11626dc7c crimson: remove CommonClientRequest, move do_recover_missing to PG a85888fa693 crimson/.../client_request_common: convert do_recover_missing to use coroutine 05230fc9bf0 crimson/.../client_request_common: convert do_recover_missing to use log macros bd95adc5949 crimson: finish_decode() of MOSDRepOp on target core d5f6d033b61 crimson: handle_rep_op_reply downgrade stale message to debug ad38967a5b9 mgr/vol: for "clone status" handle case where path goes missing 2afbc2ff9d1 rgw/rgw_cksum: work around -Wsometimes-uninitialized 7ae0c22dfd6 doc: update cephfs-journal-tool docs aa54c08eb01 common/options: fix typo in description a8b12bbc8c9 mds: add some perf counters about cache trimming 20a651b8fd5 mgr/dashboard: Added application label to pool_metadata query 65328aca31f libcephfs / pybind: use uid_t and gid_t instead of int 5e47f671160 rgw: prefetch data from versioned object instance head 28b15bd1ec5 src/test: test sync/async i/o code paths with huge (4GiB) buffers 4ff38bdecae osd/PrimaryLogPG: Relax replicated reads when recovering bb52cb72abe cephfs: session tracker accounts for killing sessions 76f10dbc1fd mgr/nfs: Add VIP to HAProxy_Hosts list for imgress type haproxy-protocol 47166556c5b RGW: When using Keystone auth for RGW, include the Keystone user in ops log 1cb23c32e65 crimson: fix unused variable warnings due to assert() and NDEBUG builds 970b07923bb osd: be more verbose in OSD::run_osd_bench_test ce4a7831ea4 qa/tasks/ceph_manager: population must be a sequence ad1716ff157 qa/cephfs: test that user created pool is not deleted by... c0c8b993b2e rgw/rados: create_bucket() passes non-null dpp to get_bucket_info() 747557da731 rgw: frontend reads/writes respect rgw_beast_enable_async 7f2f0288e89 mgr/cephadm: Add command to stop host drain f93e6990301 auth/AuthRegistry: include cleanup ac3ba2d3d82 auth/cephx: add missing includes 2ec0d9be427 auth: add missing include d48b71c37a2 auth/Auth: add missing includes 0d53436d226 qa: test empty string arg during subvol create e94da523c83 doc: new CephString attribute 'allowempty' 977ac61a582 mgr/volumes: tag args with allowempty=false 4031f55e555 pybind: add 'allowempty' as a CephString attribute 36e31bc338a qa: don't pass spurious empty string in lieu of subvol options 4299f660ba9 mgr/vol: don't delete user-created pool in "volume create" command 40ab7c26a99 os/bluestore: Add printing shards to Onode::printer 8fcb0b67409 mgr/dashboard: Bump grafana version to 11.6.0 7f821708216 osd: fix init of op_queue_type_t due to returnable ceph_assert() d67864476a1 mgr/cephadm/tests: handle "stop" daemon action in test_cephadm.py 2d248199cda mgr/cephadm: fix staggered upgrade daemon type warning 9564bd85817 mgr/cephadm: add smb to gateway types so it is upgraded 87ff016584e erasure-code: reformat EC plugins 16bc30c9553 mgr/cephadm/module.py: Run ok_to_stop logic for stop f931921f2f9 mgr/nfs: make sure sectype is a list when parsed 8c27efcf0e4 doc/rados/operations: Improve stretch-mode.rst 460a62b3be6 tasks/cephfs/mount: use 192.168.144.0.0/20 for brxnet 4289371b20b osd_types: Restore new_object marking for delete missing entries 98e1554563c test/mds: Fix catch by value ee944912fee test/common: Fix signed comparison 876cb5f2c4d test/objectstore: Fix signed comparison warning fa71769f356 common/not_before_queue: Fix signed comparison warning 7626c12e5fd ceph-volume: refactor LvmBlueStore.setup_device() 9c797f52a46 build: Fix opentelemetry-cpp build failure on Noble 75cd8c074f3 mds: MDCache: check validity of mdr requests before dispatching e63f8cc54d0 mds: MDCache request cleanup handles potential null mdr 2d4ee6aea3a doc/cephadm: improve "Maintenance Mode" a732b486384 fmt: bump up version to 11.1.4 b3316073b0f OSDMonitor: Make sure pcm is initialised c5a316cfd5e Use system-defined location for home directories 368f9b07b62 doc/dev/release-checklists: add vX.3.0 checklist item a17871dc706 doc/dev/release-checklist: check v20.0.0 tag d7005063be2 test/osd: Adapt strategy for testing asserts in interval_sets fecbb3aa07b src/common/options: Clarify mon_target_pg_per_osd in mgr.yaml.in 3ead485887d tools/kvstore_tool: add missing `#ifdef WITH_BLUESTORE` 71d5e90c44b tools/kvstore_tool: make load_bluestore() `private` 3e63860433a doc: mgr/dashboard: add OAuth2 SSO documentation 618025908cc mgr/DaemonServer: fixed mistype for mgr_osd_messages 55ce1782e15 rgw: make keystone work without admin token(service ac requirement) b31fbab5bef The compilation of ISAL compress in the current code depends on the macro HAVE_NASM_X64_AVX2. However, the macro HAVE_NASM_X64_AVX2 has been removed, resulting in the compression not using ISAL even if the compressor_zlib_isal parameter is set to true. 074f05ae294 qa: test failure for duplicate retention spec 59ec7a9bcda mgr/snap_schedule: fix message format error e87974613cc test/objectstore/TestRocksdbOptionParse.cc: Fix race hazard Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Diffstat (limited to 'recipes-kernel')
0 files changed, 0 insertions, 0 deletions