Package: deriva 0.1.0
deriva: Tidy Drift Detection for Monitored Machine Learning Models
Detects concept drift and data drift in streams produced by deployed machine learning models, using a tidy interface that composes with the 'tidymodels' ecosystem. Detectors are specified, fitted on a baseline period, and advanced over new batches of observations, returning tibbles annotated with warning and drift flags. A catalogue of 22 sequential drift detectors is provided. Error-based methods include the Drift Detection Method (DDM) of Gama et al. (2004) <doi:10.1007/978-3-540-28645-5_29>, the Early Drift Detection Method (EDDM) of Baena-Garcia et al. (2006), the Hoeffding's inequality based Drift Detection Methods (HDDM) of Frias-Blanco et al. (2015) <doi:10.1109/TKDE.2014.2345382>, and the Exponentially Weighted Moving Average (EWMA) chart of Ross et al. (2012) <doi:10.1016/j.patrec.2011.08.019>. Distribution-based methods include Adaptive Windowing (ADWIN) of Bifet and Gavalda (2007) <doi:10.1137/1.9781611972771.42>, Kolmogorov-Smirnov Windowing (KSWIN) of Raab et al. (2020) <doi:10.1016/j.neucom.2019.11.111>, and the Page-Hinkley test of Page (1954) <doi:10.1093/biomet/41.1-2.100>.
Authors:
deriva_0.1.0.tar.gz
deriva_0.1.0.zip(r-4.7-any)deriva_0.1.0.zip(r-4.6-any)deriva_0.1.0.zip(r-4.5-any)
deriva_0.1.0.tgz(r-4.6-any)deriva_0.1.0.tgz(r-4.5-any)
deriva_0.1.0.tar.gz(r-4.7-any)deriva_0.1.0.tar.gz(r-4.6-any)
deriva_0.1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
deriva/json (API)
| # Install 'deriva' in R: |
| install.packages('deriva', repos = c('https://bonijoao.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/bonijoao/deriva/issues
Pkgdown/docs site:https://bonijoao.github.io
Last updated from:e0eedea496. Checks:9 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel | OK | 189 | ||
| source / vignettes | OK | 179 | ||
| linux-release | OK | 134 | ||
| macos-release | OK | 163 | ||
| macos-oldrel | OK | 160 | ||
| windows-devel | OK | 88 | ||
| windows-release | OK | 108 | ||
| windows-oldrel | OK | 75 | ||
| wasm-release | OK | 126 |
Exports:add_prediction_erroradvanceaugmentdetect_driftdrift_detectorfitglancesim_dist_streamsim_drift_streamtidy
Dependencies:cligenericsgluelifecyclemagrittrpillarpkgconfigrlangtibbleutf8vctrs
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Build a drift signal from model predictions | add_prediction_error |
| Advance a fitted drift detector over a new batch | advance advance.drift_detector_fit |
| Annotated observations from a fitted drift detector | augment.drift_detector_fit |
| Plot the monitored signal with drift markings | autoplot.drift_detector_fit |
| Detect drift in a signal column (one-shot shortcut) | detect_drift |
| Specify a drift detector | drift_detector |
| Fit a drift detector on a baseline period | fit.drift_detector |
| One-row summary of a fitted detector | glance.drift_detector_fit |
| Simulate a continuous stream with a known distribution-shift point | sim_dist_stream |
| Simulate a binary error stream with a known drift point | sim_drift_stream |
| Drift points of a fitted detector | tidy.drift_detector_fit |
