Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] master from netdata:master #334

Merged
merged 10 commits into from
Jan 31, 2025
Merged

Conversation

pull[bot]
Copy link

@pull pull bot commented Jan 31, 2025

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.1)

Can you help keep this open source service alive? 💖 Please sponsor : )

Summary by Sourcery

Refactor code formatting in perflib-ad.c, perflib-netframework.c, windows_plugin.c, and add support for Active Directory Certificate Services (ADCS) metrics collection in perflib-adcs.c. Update metadata.yaml to include the new ADCS metrics.

New Features:

  • Add support for collecting metrics from Active Directory Certificate Services (ADCS).

Enhancements:

  • Format code in perflib-ad.c, perflib-netframework.c, and windows_plugin.c using clang-format to improve readability and maintainability.

Tests:

  • Update go.d mysql collector tests to use MariaDB v5.5.64.

ilyam8 and others added 10 commits January 31, 2025 15:19
* Add LTO support in CMake build system.

Internally, CMake calls LTO ‘Interprocedural Optimization’, and it
provides functionality for checking for support for this as well as
enabling it by default for targets. This leverages that support to
auto-detect LTO and enable it if it’s supported.

* Default to disabling LTO for Debug builds.

* Add handling for LTO to netdata installer code.

* Switch back to DISABLE_LTO as option name.

Using `ENABLE_LTO` leads to a possibility for confusion among users, as it
does behave in the most intuitive manner. Instead of ensuring that LTO
is used (and thus behaving like every other `ENABLE_*` option we have),
it allows the usage LTO if it’s supported. Thus a build with
`-DENABLE_LTO=True` may not actually be built with LTO.

By instead using `DISABLE_LTO`, the behavior matches up directly with
how most people are likely to interpret the meaning, because a build
with `-DDISABLE_LTO=True` will _never_ have LTO flags added to the
compiler/linker flags.

* Fix condition for determining default for DISABLE_LTO.

* Turn off LTO auto-detection in RPM package builds.

On pretty much all RPM platforms, the RPM build process itself will
correctly add the required compiler flags when building, so we don’t
actually need to auto-detect LTO support in CMake here.

Additionally, on at least some RPM platforms, CMake’s auto-detection
for LTO support actually breaks the build when used.

* Disable function and data sections when using LTO.

On at least some systems, `-fdata-sections` combined with LTO reliably
causes failures at link time with our code.

The final binary size on systems where the combination _works_ differs by
no more than a few KiB on average (tested on 64-bit x86 on Ubuntu 22.04,
Debian 12, Fedora 39, and Rocky Linux 9), so we’re not actually getting
almost any benefit out of using both with things as they are now, but
LTO gives us a meaasurable performance improvement that per-function and
per-data sections do not.

* Restructure in-line with current repo state.

* Disable LTO on Windows builds since it doesn’t work there.

* Fix compiler flag handling order.

* Switch LTO option name to USE_LTO for consistency with USE_MOLD.
@pull pull bot added the ⤵️ pull label Jan 31, 2025
@pull pull bot merged commit 852e54a into webfutureiorepo:master Jan 31, 2025
Copy link

sourcery-ai bot commented Jan 31, 2025

Reviewer's Guide by Sourcery

This pull request introduces several new metrics for monitoring Active Directory and .NET Framework performance, enhancing the visibility of these critical Windows services. It also includes changes to the build system to ensure that the code is compiled with the required flags.

Class diagram for Windows Plugin Modules

classDiagram
    class proc_module {
        +char* name
        +char* dim
        +int enabled
        +int (*func)(int update_every, usec_t dt)
    }

    class win_modules {
        +GetSystemUptime
        +GetSystemRAM
        +PerflibProcesses
        +PerflibProcessor
        +PerflibMemory
        +PerflibStorage
        +PerflibNetwork
        +PerflibObjects
        +PerflibHyperV
        +PerflibThermalZone
        +PerflibWebService
        +PerflibMSSQL
        +PerflibNetFramework
        +PerflibAD
        +PerflibADCS
    }

    win_modules --> proc_module : contains[]
Loading

File-Level Changes

Change Details Files
Added new metrics for monitoring Active Directory performance.
  • Added metrics for directory operations (reads, writes, searches) broken down by source.
  • Added metrics for name cache lookups and hits.
  • Added metrics for LDAP searches.
  • Added metrics for DRA replication properties updated and filtered.
  • Added metrics for DRA replication compressed traffic (intersite and intrasite).
  • Added metrics for DRA replication pending syncs and sync requests.
  • Added metrics for directory service threads in use.
  • Added metrics for LDAP bind time and successful binds.
  • Added metrics for ATQ request latency.
  • Added metrics for database operations (adds, deletes, modifies, recycles).
src/collectors/windows.plugin/perflib-ad.c
src/collectors/windows.plugin/metadata.yaml
Added new metrics for monitoring .NET Framework performance.
  • Added metrics for CLR exceptions (filters, finallys, thrown).
  • Added metrics for CLR interop (stubs, marshals).
  • Added metrics for CLR JIT (compiles, failures).
  • Added metrics for CLR loading (assemblies, classes, failures).
  • Added metrics for CLR remoting (channels, context bound classes/objects, proxies, contexts, remote calls).
  • Added metrics for CLR security (link-time checks, runtime checks, stack walk depth).
  • Added metrics for CLR locks and threads (physical threads, recognized threads, contentions).
src/collectors/windows.plugin/perflib-netframework.c
src/collectors/windows.plugin/metadata.yaml
src/collectors/windows.plugin/integrations/net_framework.md
Added new metrics for monitoring Active Directory Certificate Services.
  • Added metrics for certificate requests, failed requests, issued requests and pending requests.
  • Added metrics for certificate request processing time.
  • Added metrics for certificate retrievals.
  • Added metrics for certificate retrieval processing time.
  • Added metrics for certificate challenge responses.
  • Added metrics for certificate cryptographic signing time.
  • Added metrics for certificate policy module processing time.
  • Added metrics for signed certificate timestamp lists and processing time.
src/collectors/windows.plugin/perflib-adcs.c
src/collectors/windows.plugin/metadata.yaml
src/collectors/windows.plugin/windows_plugin.c
src/collectors/windows.plugin/windows_plugin.h
Updated the build system to ensure that the code is compiled with the required flags.
  • Added a required compiler flag for exceptions.
  • Added support for LTO (Link Time Optimization).
  • Added a check to ensure that the code is compiled with the required flags.
packaging/cmake/Modules/NetdataCompilerFlags.cmake
CMakeLists.txt
src/daemon/main.c
Minor changes to other files.
  • Updated the sqlite database to include node_id.
  • Updated the aclk to send node instances.
  • Updated the installer to support LTO.
  • Updated the documentation to remove references to the old dashboard.
  • Updated the go collector to fix a bug.
src/database/sqlite/sqlite_aclk.c
src/database/sqlite/sqlite_metadata.c
src/aclk/aclk.c
src/aclk/aclk.h
netdata-installer.sh
packaging/installer/functions.sh
.codacy.yml
README.md
docs/dashboards-and-charts/README.md
docs/glossary.md
src/collectors/statsd.plugin/README.md
src/database/sqlite/sqlite_metadata.h
src/go/plugin/go.d/collector/mysql/collector_test.go
src/go/plugin/go.d/collector/mysql/collect.go
.gitignore
docs/developer-and-contributor-corner/python-collector.txt
netdata.spec.in
src/health/notifications/alarm-notify.sh.in
.github/workflows/dashboard-pr.yml

Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!
  • Generate a plan of action for an issue: Comment @sourcery-ai plan on
    an issue to generate a plan of action for it.

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants