| 1 | 1 | simandl | HotSaNIC |
| 2 | | | HTML overview to System and Network Information Center |
| 3 | | | by Bernd Pissny ( hotsanic@bernisys.prima.de / http://www.bernisys.prima.de ) |
| 4 | | | |
| 5 | | | ---------------------------------------------------------------------- |
| 6 | | | |
| 7 | | | HotSaNIC version history |
| 8 | | | |
| 9 | | | 0.5.0 - (pre-released) pre6 |
| 10 | | | new features: |
| 11 | | | solaris support available via CVS and as snapshot on the project's |
| 12 | | | more *BSD support homepage |
| 13 | | | bugfixes new changelog order since pre6: recent changes first! |
| 14 | | | better HTML output o logging completely rewritten. Verbosity now much |
| 15 | | | better logging output better configurable. (2004/07) |
| 16 | | | o TRAFFIC module now handles "/" characters in |
| 17 | | | devicenames correctly (i.e. to monitor Cisco |
| 18 | | | routers' interfaces) |
| 19 | | | o sampling will be throttled when last sample took |
| 20 | | | too long. This avoids possible high load when |
| 21 | | | consuming shell-commands are needed for sampling |
| 22 | | | (for example the "mailq" command) |
| 23 | | | o samples will not be taken if last sampling was |
| 24 | | | <10s ago |
| 25 | | | o new module option "nodaemon" starts module in |
| 26 | | | foreground for testing and debugging purposes |
| 27 | | | o HTML frames support: makeindex.pl generates |
| 28 | | | additional page "frame.html" which embeds |
| 29 | | | "index.html" and "menu.html" to improve |
| 30 | | | navigation. |
| 31 | | | o better timestamped logging output you may select: |
| 32 | | | no, classic (seconds) and human readbale |
| 33 | | | timestamps |
| 34 | | | o basically configurable main page style |
| 35 | | | (background/text/link colors and background-image) |
| 36 | | | o new module for NTP servers |
| 37 | | | o SNMP libraries will be imported directly by |
| 38 | | | HotSaNICmod.pm instead of the module-script |
| 39 | | | o BIND module corrected! Now shows TRUE values which |
| 40 | | | are NOT multiplied by 10 |
| 41 | | | o database type for BIND module changed from GAUGE |
| 42 | | | to COUNTER (please call update script!) |
| 43 | | | o supports userdefined global HRULE definitions for |
| 44 | | | each module. |
| 45 | | | o module-howto added (short docu that might help you |
| 46 | | | building own modules) |
| 47 | | | o generate valid HTML 3.2 files |
| 48 | | | o more complex HTML headers |
| 49 | | | o makeindex scripts use new library for HTML output: |
| 50 | | | HotSaNIChtml.pm |
| 51 | | | o fixed SNMP routines in system module |
| 52 | | | o internal handling of settings changed. (settings |
| 53 | | | are now stored in a single hash of vars and |
| 54 | | | arrays) |
| 55 | | | o added script to easily extend DBs with new |
| 56 | | | datarows |
| 57 | | | o tools/checkdbs.sh now has some consistency checks |
| 58 | | | and path evaluations, same goes for |
| 59 | | | checkversions.sh |
| 60 | | | o some bugfixes in MAILQ, SYSTEM (cpu) |
| 61 | | | o some logging cosmetics to improve readability |
| 62 | | | o updated documentation |
| 63 | | | o if AUTOINDEX=yes is configured, makeindex will be |
| 64 | | | called directly after module initialization |
| 65 | | | (switched off by default) |
| 66 | | | o data-smpling will be triggered directly after |
| 67 | | | startup to initialize all DBs properly, diagrams |
| 68 | | | will be built 30sec after start, thumbnails will |
| 69 | | | follow 60sec after start |
| 70 | | | o "LAST" values will be shown as well in most hourly |
| 71 | | | graphs now |
| 72 | | | o added fallback to "ps" in HotSaNICparser::get_pid |
| 73 | | | function in case /proc is not available |
| 74 | | | o diagram scripts improved: colors configurable, |
| 75 | | | better initial scaling, alternative fixed scaling, |
| 76 | | | alternative logarithmic scaling possible for |
| 77 | | | modules that don't show negative values, |
| 78 | | | commandline options available (call with option |
| 79 | | | "h" for help), better unit handling for |
| 80 | | | bytes/bits, several SI units etc. |
| 81 | | | o new funtions in HotSaNICdiagram.pm and |
| 82 | | | HotSaNICparser.pm for comfortable configuration |
| 83 | | | parsing and graph initialisation |
| 84 | | | o DISKIO supports /proc/partitions and |
| 85 | | | /proc/diskstats as well (support for kernel 2.4 |
| 86 | | | and later) |
| 87 | | | o consistency check tool "checklibs.sh" added |
| 88 | | | o checkversions.sh does some path checks |
| 89 | | | o checkdbs.sh tool may now be called without |
| 90 | | | parameters from any module directory |
| 91 | | | o WORMS module uses HotSaNIClogparse.pm functions to |
| 92 | | | analyze apache logfiles |
| 93 | | | o fixed some links pointing to proc.html in SYSTEM |
| 94 | | | makeindex script |
| 95 | | | o nonexisting SYSTEM-uptime graph removed from |
| 96 | | | "hourly" index |
| 97 | | | o SENSORS graphs sorted by name instead of DB name |
| 98 | | | o SENSORS graph scaling changed (now scaled to |
| 99 | | | configured min/max value initially) |
| 100 | | | o setup bug fixed - now text is displayed BEFORE |
| 101 | | | waiting for the answer (autoflush wasn't set) |
| 102 | | | o common graph-options in diagrams scripts are |
| 103 | | | stored in an arry now for better maintainance |
| 104 | | | o all setup scripts converted to PERL |
| 105 | | | o RRDs::update functions moved to central |
| 106 | | | HotSaNICmod.pm library - improves debugging |
| 107 | | | o improved log-parsing functions |
| 108 | | | o added version reports in debug mode |
| 109 | | | o all diagrams.pl scripts use an @OPTIONS array for |
| 110 | | | common diagram options |
| 111 | | | o some corrections for SYSTEM's HTML-index files |
| 112 | | | |
| 113 | | | pre5 |
| 114 | | | |
| 115 | | | o added MAILQ module to show stats for the Postfix |
| 116 | | | mailserver's queue items |
| 117 | | | o added a library to handle user interactions |
| 118 | | | o started to convert setup scripts to perl |
| 119 | | | o added NETSTAT module to show stats for open TCP |
| 120 | | | sockets |
| 121 | | | o fixed bugs causing "not a simple integer" errors |
| 122 | | | with rrdtool 1.0.46 |
| 123 | | | o MD5 checksums for tarballs |
| 124 | | | o new BIND module for BIND nameserver stats |
| 125 | | | o PING module support for solaris |
| 126 | | | o SENSOR module supports FreeBSD |
| 127 | | | o SENSOR module autodetects sensors on setup |
| 128 | | | o APCUSV module supports "ONBATT" and "REPLACEBATT" |
| 129 | | | status |
| 130 | | | o SHOUTCAST module supports LWP:: library |
| 131 | | | o more centralized functions in libraries |
| 132 | | | o most backtick calls converted to "open" calls |
| 133 | | | o replaced "pwd" and "find" by PERL's Cwd:: and |
| 134 | | | File::Find |
| 135 | | | o HotSaNICshellio.pm now handles user-interaction |
| 136 | | | for most modules |
| 137 | | | o image creation date format corrected |
| 138 | | | o improved log-format for modules |
| 139 | | | o improved module version report functions |
| 140 | | | o all scripts use /usr/bin/env as shell-magic-cookie |
| 141 | | | o all diagram scripts converted to PERL |
| 142 | | | o some diagram cosmetics |
| 143 | | | o tools/warnings.pl has mail capabilities |
| 144 | | | o debug-info-tool tools/checkversions.sh added |
| 145 | | | |
| 146 | | | pre4 |
| 147 | | | |
| 148 | | | o completely new concept! The directory structure |
| 149 | | | has been changed a lot, all modules are kept in a |
| 150 | | | subdirectory now. The modules now run as single |
| 151 | | | daemons, the main script uses signalling |
| 152 | | | techniques to control the modules. This saves a |
| 153 | | | lot of compilation time on every SAMPLE call. To |
| 154 | | | avoid too many modules running parallel, a random |
| 155 | | | scheduler has been added. |
| 156 | | | o modules now have a ".description" file which will |
| 157 | | | be printed when doing the main setup. |
| 158 | | | o all perl scripts now end with ".pl" |
| 159 | | | o the SYSTEM module is now configurable to enable or |
| 160 | | | disable some of its specific targets. New targets |
| 161 | | | "interrupts" and "uptime" have been added. Basic |
| 162 | | | OS X support (testing). MultiCPU systems fully |
| 163 | | | supported. swap stats are now stored in mem.rrd, |
| 164 | | | loadavg.rrd has been renamed to load.rrd. New |
| 165 | | | method gathering mem and swap info on NetBSD. |
| 166 | | | Comments have been added for later addition of |
| 167 | | | kernel >2.4 support. |
| 168 | | | o the protocol used by the PING module is now |
| 169 | | | configurable. You can also configure it to use the |
| 170 | | | ping shellcommand instead of Net::Ping. The |
| 171 | | | minimum number of pings to be sent is 5 now. |
| 172 | | | Timing will be done by Time::HiRes (if available) |
| 173 | | | and does a fallback to the previous sysdcall. If |
| 174 | | | no HiRes timers are available, you will get an |
| 175 | | | error message. |
| 176 | | | For better comparison of diagrams, the initial |
| 177 | | | upper border can be configured. The lower border |
| 178 | | | has been adapted for logarithmic scale. |
| 179 | | | Data will be stored in seconds now instead of |
| 180 | | | milliseconds. |
| 181 | | | The module should generate no more zombies now. |
| 182 | | | o SENSORS now has FreeBSD support |
| 183 | | | o TRAFFIC module now with OS X support. Devices are |
| 184 | | | no longer configured multiple times. Taken down |
| 185 | | | BSD interfaces handled correctly. Don't use DNS |
| 186 | | | lookups anymore when using netstat. BSD setup |
| 187 | | | patched. |
| 188 | | | o APPS now handles applications with "." in filename |
| 189 | | | correctly |
| 190 | | | o DISKIO now with basic kernel 2.4 device |
| 191 | | | autodetection. Some excludes applied in devicelist |
| 192 | | | (fd* md*). Module seems to worn on FreeBSD now. |
| 193 | | | Some comments have been added for later |
| 194 | | | implementation of new Kernel 2.4 |
| 195 | | | "/proc/partitions" support. |
| 196 | | | o PART module device detection corrected. Automatic |
| 197 | | | excludes list enhanced. Table sorted by |
| 198 | | | devicename. |
| 199 | | | o Within each module each Operating system will be |
| 200 | | | handled by an own library in the |
| 201 | | | "./modules/<modname>/platform/" directory. There's |
| 202 | | | also a lib "common.pm" that handles all common |
| 203 | | | functions and a fallback library "default.pm" |
| 204 | | | o HotSaNIC.pm is obsolete now, but is still there to |
| 205 | | | support modules written on older versions. To |
| 206 | | | adapt older modules to new concept, there's a |
| 207 | | | wrapper script available under "./tools/" |
| 208 | | | o all global libraries from HotSaNIC.pm were split |
| 209 | | | into different files, these are kept in the |
| 210 | | | "./lib/" directory |
| 211 | | | o all global functions in the read-data.pl scripts |
| 212 | | | have benn moved into the new HotSaNICmod.pm |
| 213 | | | library. read-data.pl just initializes the module |
| 214 | | | - the main loops, help texts etc are in the |
| 215 | | | library. |
| 216 | | | o all read-data.pl scripts support cmdline |
| 217 | | | parameters similar to sysV-style |
| 218 | | | (start/stop/status ...) |
| 219 | | | o modules' configuration can be reloaded while |
| 220 | | | running |
| 221 | | | o SOLARIS is now supported by some Modules: apcusv, |
| 222 | | | apps, ping, system (processes, CPU, load, users, |
| 223 | | | swap, mem). |
| 224 | | | o all diagram scripts are converted to PERL now |
| 225 | | | o main index now has multi-row support (mainly used |
| 226 | | | for MultiCPU machines and SNMP targets) |
| 227 | | | o instead of using the shell-magic cookie (#! ...) |
| 228 | | | directly, we use "#!/usr/bin/env ..." to avoid |
| 229 | | | conflicts on some systems. This makes the Automake |
| 230 | | | system obsolete (saves us work...). |
| 231 | | | o a lot more SNMP support had been addeed - all SNMP |
| 232 | | | related core-functions are in the |
| 233 | | | "./lib/HotSaNICsnmp.pm" file. These should be |
| 234 | | | quite compatible with quite many SNMP daemons. If |
| 235 | | | Net::SNMP isn't found, the system does a fallback |
| 236 | | | to the shell binaries. (snmpget, snmpwalk, |
| 237 | | | snmpbulkget, snmpbulkwalk). |
| 238 | | | o fixed bug which produces GIFs instead of PNGs |
| 239 | | | regardless of settings |
| 240 | | | o all logfiles moved to the new "./var/log/" |
| 241 | | | directory, PID files went in "./var/run/", all |
| 242 | | | settings are linked in "./var/settings/" by the |
| 243 | | | main setup script. Modules store their temp. data |
| 244 | | | in "./var/modules/<modname>/" |
| 245 | | | o main setup.pl script shows usage info when called |
| 246 | | | with parameter "?" |
| 247 | | | o setup will initially guess CONVERTMETHOD now |
| 248 | | | o some diagram-titles look a bit nicer now |
| 249 | | | o some files were moved and renamed, so when |
| 250 | | | upgrading it may be necessary to re-run the main |
| 251 | | | "setup.pl -g" to re-generate the rrdgraph script. |
| 252 | | | o some vital paths will be created automatically now |
| 253 | | | o all "use diagnostics" and "use warnings" were |
| 254 | | | moved to the libraries, since once loaded they act |
| 255 | | | globally in PERL. |
| 256 | | | o for better readability in system tools like "ps" |
| 257 | | | or "top", the module name will be passed as |
| 258 | | | cmdline parameter. |
| 259 | | | o new PID handling functions implemented |
| 260 | | | o some shell-calls have been converted to PERL |
| 261 | | | syntax to avoid backticks. |
| 262 | | | o the main diagrams script has been converted to |
| 263 | | | PERL. It now generates some console-output when |
| 264 | | | running( some people were confused by the previous |
| 265 | | | behaviour of it running silently in the |
| 266 | | | background). The logfile will now be handled by |
| 267 | | | rrdtimer. |
| 268 | | | o modules are automatically restarted every STIME if |
| 269 | | | not running |
| 270 | | | o rrdtimer.pl uses an anlternate daemonizing method |
| 271 | | | to avoid shells hanging while logging out (mostly |
| 272 | | | works!) |
| 273 | | | sending a HUP to rrdtimer, the modules will also |
| 274 | | | be terminated, sending USR2 only the modules will |
| 275 | | | be terminated (and will be restarted after STIME) |
| 276 | | | o main loop now sleeps more efficiently using less |
| 277 | | | CPU time |
| 278 | | | o added more debugging verbosity to scheduler |
| 279 | | | |
| 280 | | | pre3 |
| 281 | | | |
| 282 | | | o directory structure cleaned up by creating subdirs |
| 283 | | | "modules" "lib" "var" |
| 284 | | | o modules now run as daemons (saves |
| 285 | | | compilation/configuration time) |
| 286 | | | o OS-dependent libraries for all modules, fall-back |
| 287 | | | function included |
| 288 | | | o HotSaNIC.pm split into functional parts |
| 289 | | | o libraries for much, much more SNMP support than |
| 290 | | | 0.4.0 had |
| 291 | | | o wrapper script exists to support old modules |
| 292 | | | o sampling via signal handlers |
| 293 | | | o many diagrams scripts converted to PERL for speed |
| 294 | | | Version 0.5.0-pre3 and later available as .tgz package |
| 295 | | | Other versions are only available via anonymous CVS. |
| 296 | | | |
| 297 | | | -------------------------------------------------- |
| 298 | | | 0.4.1 - (unreleased) o data-diskio generates more associative filenames |
| 299 | | | new features (Thanx Michael Renner for the valuable hints!) |
| 300 | | | bugfixes o data-diskio now supports *BSD |
| 301 | | | o data-networks now has totals for input/output and |
| 302 | | | a summary over the graph's time |
| 303 | | | o data-traffic now has a summary over the graph's |
| 304 | | | time |
| 305 | | | o HotSaNIC.pm fixed, the module name was not |
| 306 | | | detected correctly if HotSaNIC resided in subdirs |
| 307 | | | containing "-" chars! |
| 308 | | | There are also some comments added to (briefly) |
| 309 | | | explain each function's usage. |
| 310 | | | o data-traffic trouble with alias interfaces like |
| 311 | | | eth0:0 fixed |
| 312 | | | o data-ping now has a configurable maximum of |
| 313 | | | parallel processes (settings: PARALLEL="4") |
| 314 | | | o data-shoutcast is a new module to monitor user |
| 315 | | | activities on shoutcast servers |
| 316 | | | o data-diskio diagrams script converted to PERL |
| 317 | | | o rrdtimer now logs errors to the main logfile |
| 318 | | | (makes debugging a bit easier) |
| 319 | | | o data-part samples configured drives only (more |
| 320 | | | convenient on systems using autofs) |
| 321 | | | It also checks if NFS partitions are configured |
| 322 | | | and scans them on demand. This reduces deadlocks. |
| 323 | | | o data-worms now skips .gz and .bz2 files while |
| 324 | | | scanning logs |
| 325 | | | o data-traffic has been adapted to fix the "ghost |
| 326 | | | graphs" issue when graphing SNMP sources (hope it |
| 327 | | | works now) |
| 328 | | | o data-traffic graphs interfaces which are "down" as |
| 329 | | | "unknown" instead of a zero line. |
| 330 | | | All modules now contain dupe-control to check if a |
| 331 | | | process is already running or hangs. (processes |
| 332 | | | running >1h will be killed) |
| 333 | | | |
| 334 | | | IMPORTANT NOTICE FOR UPGRADERS: |
| 335 | | | The database in the diskio module has changed! - You |
| 336 | | | will need to run the update script in the module's |
| 337 | | | subdir in order to adapt the databases and the |
| 338 | | | webpage. Otherwhise you will get some missing images, |
| 339 | | | dead links and strangely high I/O-values or maybe in |
| 340 | | | some cases a zero-line. |
| 341 | | | This version is only available via anonymous CVS. |
| 342 | | | |
| 343 | | | -------------------------------------------------- |
| 344 | | | 0.4.0 - 20020108 All features of the work version 0.3.6 are included in |
| 345 | | | new features 0.4.0 plus: |
| 346 | | | extensions o data-traffic has been sped-up a bit |
| 347 | | | bugfixes o dupe-control checks for PIDs now |
| 348 | | | o project's contact address has changed to: |
| 349 | | | hotsanic@bernisys.prima.de |
| 350 | | | IMPORTANT NOTICE FOR UPGRADERS: |
| 351 | | | The database in the traffic module has changed! - You |
| 352 | | | will need to run the update script in the module's |
| 353 | | | subdir in order to adapt the databases. Otherwhise you |
| 354 | | | will get strangely high traffic values or maybe in |
| 355 | | | some cases a zero-line. |
| 356 | | | |
| 357 | | | -------------------------------------------------- |
| 358 | | | 0.3.6 - 20011217 o The main settings now contain a switch to select |
| 359 | | | new features the format of the generated images (.gif or .png). |
| 360 | | | extensions If you already have built own modules, please take |
| 361 | | | bugfixes care that they use the new feature ;) |
| 362 | | | o All graphs now have create-timestamps in their |
| 363 | | | titles |
| 364 | | | o Bugfix in dnet module: OGR stats will no longer |
| 365 | | | accident'ly be logged as DES. |
| 366 | | | o Bugfix in ping module: makeindex.pl does no longer |
| 367 | | | generate dead links. |
| 368 | | | o The ping module now does a statistic analysis of |
| 369 | | | its results to suppress annoying peaks. |
| 370 | | | o New module: data-networks which uses |
| 371 | | | iptables-accounting to let you know where your |
| 372 | | | traffic goes to/comes from |
| 373 | | | o data-traffic now supports Open/Free BSD ( Thanks |
| 374 | | | to Matt Burke! ) |
| 375 | | | o data-traffic now supports SNMP (both GetBulk and |
| 376 | | | SNMPwalk method) |
| 377 | | | o data-traffic's initial scales are set down to 1000 |
| 378 | | | bytes/s for any kind of device (better readable |
| 379 | | | graph at low traffic) |
| 380 | | | o data-traffic's diagram script has been upgraded to |
| 381 | | | evaluate settings instead of executimg the |
| 382 | | | settings-file |
| 383 | | | o data-traffic now can show a bits/s legend instead |
| 384 | | | of bytes/s only |
| 385 | | | o data-network now can show a bits/s legend instead |
| 386 | | | of bytes/s only |
| 387 | | | o data-part now supports Open/Free BSD ( Thanks to |
| 388 | | | Matt Burke! ) - the resolution is now 1024 bytes. |
| 389 | | | o data-dnet now supports configurable logfile names |
| 390 | | | ;) |
| 391 | | | o HotSaNIC.pm (a perl library containing common |
| 392 | | | functions) now exists to eliminate multiple |
| 393 | | | definitions and redundant functions in different |
| 394 | | | modules |
| 395 | | | o all initializing stuff has been moved from |
| 396 | | | "rrdgraph" to "rrdtimer" |
| 397 | | | o rrdtimer now has a signal-handler for the TERM |
| 398 | | | signal to properly shut down the daemon |
| 399 | | | o the whole tool now should be CVS-proof ;) |
| 400 | | | o some "setup" scripts now exist to create initial |
| 401 | | | configurations easier. They are called |
| 402 | | | automatically by the main "setup.pl" script. |
| 403 | | | o "compile" now supports option "r" for recompiling |
| 404 | | | (might be necessary after upgrading) |
| 405 | | | o a new module "data-diskio" exisits which reports |
| 406 | | | I/O stats of the pyhsically installed harddrives |
| 407 | | | o data-worms has been rewritten completely because |
| 408 | | | it wasn't sampling correctly at all. Should be ok |
| 409 | | | by now. |
| 410 | | | o data-system now has BSD-support ( Thanks to Matt |
| 411 | | | Burke! ) |
| 412 | | | o data-system now supports sampling CPU stats for |
| 413 | | | multi-CPU machines (images are being generated, |
| 414 | | | but the index.html will not yet be created - But |
| 415 | | | i'm working on it...) - Thanks Aide Florent for |
| 416 | | | the ideas and some support! |
| 417 | | | o data-system main CPU stats may be generated in |
| 418 | | | percentage instead of absolute values |
| 419 | | | o all modules can generate a browser auto-refresh |
| 420 | | | tag now. |
| 421 | | | o all thumbnail images are moved to the |
| 422 | | | corrosponding subdirs on the webpage to re-gain |
| 423 | | | more overview. |
| 424 | | | o HotSaNIC.pm now contains a parser function for the |
| 425 | | | settings. All modules have been adapted to use |
| 426 | | | this function instead of parsing the lines on |
| 427 | | | their own (read-data.pl and makeindex.pl are |
| 428 | | | affected). |
| 429 | | | o added a directory "tools" where a few helpers |
| 430 | | | could be located. |
| 431 | | | o tools: makeperlheaders (call if ping module |
| 432 | | | complains about missing syscall.ph) |
| 433 | | | o stop function in "rrdgraph" script is now |
| 434 | | | BSD-proof :) ( Thanx to Peter Reich! ) |
| 435 | | | o tools: warnings.pl generates warnings if a defined |
| 436 | | | threshold matches (for example 20KB/s on eth0 over |
| 437 | | | the last 5 minutes) |
| 438 | | | o data-traffic: diagram script converted to perl now |
| 439 | | | o data-system: shows user-stats now |
| 440 | | | o all modules: main options are being transfered to |
| 441 | | | the read-data scripts by rrdtimer as |
| 442 | | | commandline-arguments (saves parsing of mein |
| 443 | | | settings over and over for some scripts) |
| 444 | | | o setup.pl: option "y" tells the script that it |
| 445 | | | shall use all available modules, settings are |
| 446 | | | being backed-up instead of creating a settings.new |
| 447 | | | file and leaving the original untouched |
| 448 | | | o rrdtimer: debugging mode also available in |
| 449 | | | daemon-mode (configured in main settings) |
| 450 | | | o all modules: dupe control added. If a module is |
| 451 | | | already running, don't start it again until the |
| 452 | | | old instance exits (control-file: "running.dat"). |
| 453 | | | o data-system: now with NetBSD support |
| 454 | | | o data-system: showing processes on FreeBSD |
| 455 | | | plus: many many little bugfixes i forgot to mention |
| 456 | | | here ;) |
| 457 | | | |
| 458 | | | -------------------------------------------------- |
| 459 | | | 0.3.5 - 20010923 Bugfixes: |
| 460 | | | bugfixes o Missing directories in the module-subdirs are now |
| 461 | | | new module being created as they should be. Sorry for the |
| 462 | | | inconvenience! |
| 463 | | | o I corrected some misbehavior with directories |
| 464 | | | containing spaces. (correction may not affect |
| 465 | | | every module yet - remember that the project is |
| 466 | | | still in ALPHA state) |
| 467 | | | enhanced logging - timestamps are now present in some |
| 468 | | | modules and logfiles get rotated when they reach the |
| 469 | | | configured size. (at the moment only one backup is |
| 470 | | | kept - cyclic backups will be implemented soon.) |
| 471 | | | A new module "data-worms"exists which counts the |
| 472 | | | accesses caused by worm-activities in your |
| 473 | | | apache-logfile. |
| 474 | | | |
| 475 | | | -------------------------------------------------- |
| 476 | | | 0.3.4 - 20010918 I have extended "rrdtimer" a lot! |
| 477 | | | rrdtimer o The script now has many sub-routines which will |
| 478 | | | make debugging much easier - well, at least i hope |
| 479 | | | so ;). |
| 480 | | | o The main "makeindex.pl" now has been integrated |
| 481 | | | into "rrdtimer" to get the whole thing more |
| 482 | | | compact. To generate the html index-files just |
| 483 | | | type "rrdtimer i" - that's all. I left the |
| 484 | | | "makeindex.pl" in this directory for |
| 485 | | | compatibility, but this is just a shellscript that |
| 486 | | | calls "rrdtimer i". ;) |
| 487 | | | o The way you call "rrdtimer" has changed a bit - |
| 488 | | | just type "rrdtimer" on the console to get some |
| 489 | | | help. |
| 490 | | | Soon "rrdtimer" will be extended to replace "diagrams" |
| 491 | | | and "convert.sh" as well. |
| 492 | | | |
| 493 | | | -------------------------------------------------- |
| 494 | | | 0.3.3 - 20010916 I found a proper name for my tool: From now on it |
| 495 | | | bugfixes: shall be called "HotSaNIC" which stands for "HTML |
| 496 | | | rrdtimer overview to System and Network Information Center". |
| 497 | | | On execution "rrdtimer" checked for existing daemons |
| 498 | | | using the wrong program-name (rrdgraph instead of |
| 499 | | | rrdtimer). |
| 500 | | | "rrdtimer" doesn't any longer just execute |
| 501 | | | "read-data", but also checks for uncompiled |
| 502 | | | "read-data.pl" scripts, too - while "read-data" has |
| 503 | | | the highest priority. |
| 504 | | | |
| 505 | | | -------------------------------------------------- |
| 506 | | | 0.3.2 - 20010915 I accidently left a debug-line "rrdtimer" script which |
| 507 | | | bugfixes: produces unnecessary output to logfiles. |
| 508 | | | rrdtimer The "makeindex.pl" in the sensors-module had to be |
| 509 | | | sensors:makeindex fixed to generate html indexes for each sensor as |
| 510 | | | well. |
| 511 | | | I checked every script for mix-ups of integer and |
| 512 | | | string comparison. There shouldn't be any errors by |
| 513 | | | now. |
| 514 | | | |
| 515 | | | -------------------------------------------------- |
| 516 | | | 0.3.1 - 20010911 ATTENTION! |
| 517 | | | bugfixes: There is a rather serious BUG in versions < 0.3.1 ! |
| 518 | | | rrdtimer Please upgrade to version 0.3.1. |
| 519 | | | ping:makeindex |
| 520 | | | Symptom: If you restart the daemon it may happen |
| 521 | | | that no modules are queried and thus your |
| 522 | | | databases will not be updated. |
| 523 | | | |
| 524 | | | Cause: This is because i mistakenly used "le" to |
| 525 | | | compare two integer values instead of |
| 526 | | | using "<=" under PERL. Sinc e i initially |
| 527 | | | compare "120" with a timer-value which |
| 528 | | | begins with "1000", PERL states that "120" |
| 529 | | | is GREATER than "1000.*" - which is |
| 530 | | | absolutely correct in a string context. |
| 531 | | | Thanks to Bodo, Peter and Robert for the |
| 532 | | | hint that made up my mind. :) |
| 533 | | | |
| 534 | | | Cure: You may prevent this "overflow" by editing |
| 535 | | | the "rrdtimer" script and simply |
| 536 | | | exchanging all occurences of " le " by |
| 537 | | | " <= ". |
| 538 | | | |
| 539 | | | Fix: I have fixed this in version 0.3.1 and to |
| 540 | | | be on the safe side i initialise "$last" |
| 541 | | | with "$now-100" and "$lastscan" with |
| 542 | | | "$now-1000" instead of zero. That should |
| 543 | | | do it for a really really long time now |
| 544 | | | ;). |
| 545 | | | |
| 546 | | | The "makeindex.pl" in the ping-module had to be fixed |
| 547 | | | a bit. Now it generates index-files properly again. |
| 548 | | | Some bugs may occure since i will change the script's |
| 549 | | | syntaxes and variables a bit to make it possible in |
| 550 | | | future to create a library with global functions which |
| 551 | | | are commonly used in the modules' scripts. |
| 552 | | | |
| 553 | | | -------------------------------------------------- |
| 554 | | | 0.3.0 - 20010909 Added a module that pings a list of hosts, stores the |
| 555 | | | almost all ;) results in databases and creates nice graphs out of it |
| 556 | | | ;) |
| 557 | | | The sensors module has been (almost ...) completely |
| 558 | | | rewritten to give you full support to all |
| 559 | | | sensor-types. BUT! You have to know how these sensors |
| 560 | | | are represented in the /proc filesystem and how they |
| 561 | | | have to be treated properly. The module just helps to |
| 562 | | | gather the data. WHICH it shall gather ... well, |
| 563 | | | that's about up to you. But if you have some idea what |
| 564 | | | /proc is and where sensors are located it should be no |
| 565 | | | trouble at all to configure the module. Hint: some |
| 566 | | | sensors need proper scaling! This is (poorly) |
| 567 | | | described in the settings file. You should read the |
| 568 | | | lm_sensors howto to get the idea of what's happening |
| 569 | | | and put the correct scaling-values in the settigs. |
| 570 | | | Remember: Just use plain floating point numbers, not |
| 571 | | | fractions like in lm_sensors! |
| 572 | | | The partition-plugin has been altered to support NFS |
| 573 | | | volumes (and other) as well. To achieve this the |
| 574 | | | "settings" file had to be adapted and the names of the |
| 575 | | | databases have changed. Simply rename the old |
| 576 | | | databases to keep your old recordings. |
| 577 | | | I also changed the whole behaviour a bit: |
| 578 | | | ALL CONFIGURATION OPTIONS for MODULES have been moved |
| 579 | | | into the module-directories !!! |
| 580 | | | This makes it a bit easier to install or remove |
| 581 | | | modules without fiddling with the main config, WHICH |
| 582 | | | STILL RESIDES IN THE MAIN DIRECTORY! |
| 583 | | | The main "makeindex" script has been converted to perl |
| 584 | | | to let it run faster (and it sure is MUCH faster now!) |
| 585 | | | The "compile" script now can uncompile all scripts |
| 586 | | | using the "u" option |
| 587 | | | I began to convert some of the modules' "makeindex" |
| 588 | | | scripts to perl to make them run faster |
| 589 | | | |
| 590 | | | -------------------------------------------------- |
| 591 | | | 0.2.6 - 20010805 Added a module that gives you very primitive |
| 592 | | | (obsolete!) lm_sensors support (just the gl518sm sensors for now) |
| 593 | | | modules It will sure take some time to get these to work |
| 594 | | | properly... |
| 595 | | | The swap-space readings in the system-module are |
| 596 | | | extended by a "max usage" line which plots over the |
| 597 | | | whole thing to give you a hint about the "real" usage. |
| 598 | | | This maybe helps a bit in structuring your system. |
| 599 | | | |
| 600 | | | -------------------------------------------------- |
| 601 | | | 0.2.5 - 20010710 I changed the index-generation scripts so they |
| 602 | | | modules generate valid html 3.2 ... |
| 603 | | | |
| 604 | | | -------------------------------------------------- |
| 605 | | | 0.2.4 - 20010607 The "clearall" script has now an option to remove |
| 606 | | | diagrams precompiled binaries created by "compile" |
| 607 | | | clearall |
| 608 | | | "diagrams" now checks if it has been called before and |
| 609 | | | if maybe it's stalled somehow and kills it's evil |
| 610 | | | brother ;) |
| 611 | | | |
| 612 | | | -------------------------------------------------- |
| 613 | | | 0.2.3 - 20010605 Previously "rrdtimer" called all existing modules |
| 614 | | | rrdtimer parallel, but this behaviour may cause problems on |
| 615 | | | modules some systems, so i changed the default behaviour to |
| 616 | | | call all modules in a sequence. The parallel mode is |
| 617 | | | still available and can be activated by calling |
| 618 | | | "rrdtimer p" |
| 619 | | | |
| 620 | | | An additional module called "networks" has been |
| 621 | | | created. It uses ipchains to measure the traffic to |
| 622 | | | dedicated networks and evaluates these traffic samples |
| 623 | | | pretty much like the "traffic" module - except min/max |
| 624 | | | plots which would be quite a thing to implement |
| 625 | | | properly. Maybe this will come some day as an option, |
| 626 | | | but i don't think so right now. |
| 627 | | | A speedup has been added: |
| 628 | | | |
| 629 | | | Try to run the "compile" script to compile all modules |
| 630 | | | via "perlcc". This may give you a major speedup ( |
| 631 | | | about 2-3x ) because the perl modules don't have to be |
| 632 | | | compiled over and over again before they are executed |
| 633 | | | ( this happens each 10 seconds ) - but be aware that |
| 634 | | | errors may occur if some important perl-libraries are |
| 635 | | | missing! In that case you have got to live with it and |
| 636 | | | reconstruct the "read-data" scripts in each module |
| 637 | | | directory. |
| 638 | | | |
| 639 | | | I changed the global behaviour a bit. "rrdtimer" now |
| 640 | | | calls the diagram scripts itself - so cron-entries |
| 641 | | | aren't needed anymore. |
| 642 | | | |
| 643 | | | The modules now generate timestamps in the |
| 644 | | | "rrdtimer.err" logfile. |
| 645 | | | |
| 646 | | | The name of the PID-file is now free configurable in |
| 647 | | | the settings file. |
| 648 | | | |
| 649 | | | -------------------------------------------------- |
| 650 | | | 0.2.2 - 20010514 Debugging mode in "rrdtimer" now only shows 4 digits |
| 651 | | | rrdtimer after decimal point for better readability. |
| 652 | | | databases |
| 653 | | | system All databases have been moved to a subdirectory "rrd/" |
| 654 | | | in each module-subdirectory. So please move the .rrd |
| 655 | | | files into each module's subdir to the corrosponding |
| 656 | | | <module-dir>/rrd/ subdir. |
| 657 | | | |
| 658 | | | Additional logging-functionality for system-module. |
| 659 | | | Now the loadavg values for the 5min and 15min average |
| 660 | | | are logged as well. The process-stats show an |
| 661 | | | additional value "disc" representing processes being |
| 662 | | | swapped to disc at this time. |
| 663 | | | |
| 664 | | | IMPORTANT NOTICE FOR UPGRADERS: |
| 665 | | | Be sure to run "update.pl" after you installed the new |
| 666 | | | data-system module! The system.rrd database has to be |
| 667 | | | split to add the new logging-channels! Another |
| 668 | | | possibility is to just let the new scripts run and |
| 669 | | | remove system.rrd, but all previously sampled data |
| 670 | | | will be lost by doing so! |
| 671 | | | |
| 672 | | | -------------------------------------------------- |
| 673 | | | 0.2.1 - 20010510 Some bugs were fixed in the traffic, dnet and part |
| 674 | | | traffic, dnet, part modules: |
| 675 | | | convert o the "diagrams" script in the traffic-module |
| 676 | | | settings produced some errors due to a wrong |
| 677 | | | variable-assignment. |
| 678 | | | o the "diagrams" script in the part module produced |
| 679 | | | errors because "rrdtool" was called with some |
| 680 | | | parameters mixed up. |
| 681 | | | o the convert.sh script only converted the graphics |
| 682 | | | from system and dnet. Now it handles all graphics. |
| 683 | | | I played a bit with the settings-file and some of the |
| 684 | | | scripts. Now there is a configuration-entry to set |
| 685 | | | where logfiles will be stored. |
| 686 | | | Then i altered the behaviour of the DNET-module. Now |
| 687 | | | you can configure networks and their names to receive |
| 688 | | | better readable statistics for dynamic IPs. This is |
| 689 | | | done in the "data-dnet" subdir using a file called |
| 690 | | | "networks.cf" |
| 691 | | | Some speed-ups were achieved by using hashes to store |
| 692 | | | multiline values and by changing file-access |
| 693 | | | behaviours a bit. Saved about 10% execution-time :) |
| 694 | | | |
| 695 | | | -------------------------------------------------- |
| 696 | | | 0.2.0 - 20010509 Well, this is something revolutionary ;) |
| 697 | | | rrdtimer I had the time to read the PERL-FAQs and found some |
| 698 | | | dnet interesting aspects like daemonizing (i.e. fork into |
| 699 | | | background) and other stuff. So I decided to |
| 700 | | | completely rewrite the main script. This is no longer |
| 701 | | | bash, but plain PERL! Included are some features like |
| 702 | | | a debug-mode with different debug-levels to get your |
| 703 | | | modules straight. Just experiment with it if you like. |
| 704 | | | :) |
| 705 | | | Some changes were made to the dnet module as well. |
| 706 | | | I've rewritten the routines into PERL now and i hope |
| 707 | | | they will do what they are supposed to. I don't quite |
| 708 | | | know, so please inform me if anything goes wrong |
| 709 | | | there. |
| 710 | | | |
| 711 | | | -------------------------------------------------- |
| 712 | | | 0.1.9 - 20010506 I had some spare-time to spend, so while I was |
| 713 | | | dnet chatting on ICQ, I decided to give myself a little |
| 714 | | | push and have almost completely re-written the core of |
| 715 | | | the DNET module in PERL. Speed-up seems to be a factor |
| 716 | | | of about 10, though this was not really needed since |
| 717 | | | the module gets called only once a day anyway. But |
| 718 | | | major speed-up has been achieved in building the |
| 719 | | | initial databases which will reach back a couple of |
| 720 | | | months ... these are about 400 (for each host !) |
| 721 | | | database updates sequentially and this took quite a |
| 722 | | | while back in BASH ;) |
| 723 | | | I also discovered and removed a little bug in this |
| 724 | | | module. When a host has not sent any block the last |
| 725 | | | day, then the database would have taken the values of |
| 726 | | | the day before. This looks rather impressive in the |
| 727 | | | statistics, but is of course dramatically wrong :) |
| 728 | | | Ok, these stats are just looking fine right now. |
| 729 | | | |
| 730 | | | -------------------------------------------------- |
| 731 | | | 0.1.8 - 20010421 some changes were made in the "diagrams" scripts. Now |
| 732 | | | diagrams the diagrams are created in "interlace" gif mode, |
| 733 | | | traffic which will improve the load-behaviour of the webpage. |
| 734 | | | I also tuned in some additional "rrdtool"-features - |
| 735 | | | now the byte-oriented graphs have a legend on the |
| 736 | | | Y-axis and 1K is calculated by 1024 and not 1000 as |
| 737 | | | before. |
| 738 | | | The traffic module now can cope with asymmetric |
| 739 | | | interfaces as well, the MAX option in the |
| 740 | | | settings-file has a new syntax to set in and out speed |
| 741 | | | independant (of course as before in bits/s) |
| 742 | | | |
| 743 | | | -------------------------------------------------- |
| 744 | | | 0.1.7 - 20010408 further little speed-up was archieved by not using so |
| 745 | | | traffic many temp-files in the traffic-plugin. |
| 746 | | | |
| 747 | | | -------------------------------------------------- |
| 748 | | | 0.1.6 - 20010405 A little speed-up was archieved by doing some changes |
| 749 | | | read-data in the "read-data" scripts for the system and the |
| 750 | | | settings partition plug-in. Some awful shell-calls were |
| 751 | | | replaced by PERL calls which do not write in |
| 752 | | | sample-files any more, but directly into the |
| 753 | | | PERL-array :). |
| 754 | | | Also some new setting-file entries exist now to tell |
| 755 | | | the program which interfaces/devices are to sample and |
| 756 | | | which stat-graphs are to be bulit. |
| 757 | | | However, this applies only for the sample-part of the |
| 758 | | | traffic and the partition section for now... but i'm |
| 759 | | | working on it ... ;) |
| 760 | | | |
| 761 | | | -------------------------------------------------- |
| 762 | | | 0.1.5 - 20001219 Corrected a little bug in the "makeindex" files. |
| 763 | | | makeindex Weekly stats indexpage will now be built correctly. |
| 764 | | | The "makeindex" script now removes all temporary files |
| 765 | | | it creates. It also doesn't nag about existing |
| 766 | | | directories, it just silently creates them if needed. |
| 767 | | | |
| 768 | | | -------------------------------------------------- |
| 769 | | | 0.1.4 - 20001215 Corrected a missing settings-call in the "makerrd" |
| 770 | | | makerrd scripts which caused the tool to create no databases |
| 771 | | | at all. |
| 772 | | | Thanks to Markus Bajohr! |
| 773 | | | |
| 774 | | | -------------------------------------------------- |
| 775 | | | 0.1.3 - 20001209 I just corrected a bug in the part-plugin which caused |
| 776 | | | part the script to create numerous databases with no |
| 777 | | | further use, but a lot of load while building the |
| 778 | | | graphs ... |
| 779 | | | Thanks to Michael Neumann! |
| 780 | | | |
| 781 | | | -------------------------------------------------- |
| 782 | | | pre 0.1.3 I report changes and bugs since version 0.1.2 - all |
| 783 | | | earlier versions were just like the beginning of all |
| 784 | | | life ;) |
| 785 | | | |
| 786 | | | o.K. let's see. What can "rrdgraph" do right now ? |
| 787 | | | |
| 788 | | | The system-plugin ( This was my first plugin. Actually |
| 789 | | | it hasn't been a plugin up to 0.0.1 ) will collect |
| 790 | | | data about: |
| 791 | | | o processes (sleeping, running, stopped, zombie) |
| 792 | | | o CPU time (idle, nice, user, system) |
| 793 | | | o loadaverage |
| 794 | | | o memory (free, buffered, shared, cached) |
| 795 | | | o swapfile (free, used) |
| 796 | | | The traffic-plugin will collect data about all your |
| 797 | | | local network interfaces except loopback. |
| 798 | | | |
| 799 | | | The partitions-plugin collects data about your |
| 800 | | | partition-usage. |
| 801 | | | Some bugs have to be fixed here! |
| 802 | | | For example network-mounted directories will be saved |
| 803 | | | under just a part of their name. This may cause |
| 804 | | | serious problems if there are two similar paths... I |
| 805 | | | haven't checked yet, but I guess it will. |
| 806 | | | For now I will override this bug by filtering out all |
| 807 | | | network-mounted filesystems. Later i'll try to convert |
| 808 | | | the "/" in the device-pathnames to "_" and hopefully |
| 809 | | | all will be fine in future... |
| 810 | | | |
| 811 | | | -------------------------------------------------- |
