OpenNMS On the Horizon – CircleCI, Kafka, Time-Series API, Netflow, Minion, OIA
Tags: ooh, alarmhistory, circleci, elasticsearch
Published: 2020-06-01 22:08:51

---
title: OpenNMS On the Horizon – CircleCI, Kafka, Time-Series API, Netflow, Minion, OIA
published: true
date: 2020-05-26 18:22:42 UTC
tags: OOH,alarm history,circleci,elasticsearch
canonical_url: https://www.opennms.com/en/blog/2020-05-26-opennms-on-the-horizon-circleci-kafka-time-series-api-netflow-minion-oia/?utm_source=rss&utm_medium=rss&utm_campaign=opennms-on-the-horizon-circleci-kafka-time-series-api-netflow-minion-oia
cover_image: https://i.imgur.com/JIPa2Oe.png
---

In the last week we kept working on CI improvements, fixed some Kafka bugs, fixed time-series and netflow issues, the new Minion-based remote poller infrastructure, OIA integration updates, and more!

<!--
git log -author=bamboo@opennms.org -invert-grep -all -no-merges -color=always -since='2020-05-18 00:00:00' -until='2020-05-26 00:00:00' -format='%Cblue%ai %Cgreen%aN %Creset%s %Cblue(%H)%Cred%d' -author-date-order | sort | less -R
-->

## Github Project Updates

### **Internals, APIs, and Documentation**

- I did more work cleaning up and enhancing our CircleCI builds.
- Chandra fixed an issue with the alarm history elasticsearch feature when `indexPrefix` is set.
- Dustin did more work on modernizing the remote poller infrastructure.
- Pierre added new confd templates for Minion to make SSH, RMI registry, and RMI server configurable.
- Patrick did more work on fixing an issue when multiple SNMP interfaces are marked "primary" on a node.
- Chandra continued his work on improving thread-handling on the Minion.
- Chandra fixed an issue with missing parameters when forwarding events from the Kafka producer.
- Jesse fixed a regression in throughput processing of Netflow ingress packets in Horizon 26.
- Jesse fixed an issue with exceptions when persisting fails in the new time-series integration layer.
- Matt did more work on storing passwords encrypted on-disk.
- Patrick updated the OIA to expose tag names as constants accessible by integration implementers.
- Patrick updated the time-series integration layer to pass improved metadata tags.
- Ronny and I worked on some CircleCI changes that would reduce image sizes.

<!--
### __Web, ReST, UI, and Helm__
* 
-->

### Contributors

<!--
git log -all -color=always -no-merges -since='2020-05-18 00:00:00' -until='2020-05-26 00:00:00' -pretty=format:'%an' | sed -e 's,bouff,Pierre Bouffard,' -e 's,mvrueden,Markus von Rüden,' -e 's,Naicisum,Sean Torres,' -e 's,Bonrob2,Bonnie Robinson,' | sort -u | grep -vE '(dependabot|Atlassian Bamboo|CI.CD System)' | sed -e 's,^,\* ,'
-->

Thanks to all of the following contributors for committing changes since last OOH:

- Benjamin Reed
- Bonnie Robinson
- Chandra Gorantla
- Christian Pape
- Dustin Frisch
- Jesse White
- Matthew Brooks
- Patrick Schweizer
- Pierre Bouffard
- Ronny Trommer

## Calendar of Events

### **June Releases - June 2nd, 2020**

The next OpenNMS release day is June 2nd, 2020. Currently we expect point/bug fix releases of Meridian 2019 and Horizon 26.

<!--
### **[OpenNMS Training](https://hs.opennms.com/training-registration-2020) - Moonachie, New Jersey - April 27th through May 1st, 2020**
The OpenNMS Group [still hopes to be offering training](https://hs.opennms.com/training-registration-2020) at SecureWatch 24 Fusion Center in Moonachie, New Jersey the week of April 27th. 8 seats are available, and the deadline for signing up is April 17th.
-->

## Until Next Week…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to [say hi](mailto:twio@opennms.org).

- Ben

<!--
  https://github.com/OpenNMS/twio-fodder/blob/ee50b0f05f3f93a66c242448a70fdca3993b972a/scripts/twio-issues-list.pl
-->

## Resolved Issues Since Last OOH

- [ALEC-67](https://issues.opennms.org/browse/ALEC-67): Log message for situation reflects cleared state
- [ALEC-74](https://issues.opennms.org/browse/ALEC-74): Kafka streams dies and does not recover from error
- [ALEC-84](https://issues.opennms.org/browse/ALEC-84): Add Graph Provider to support ALEC
- [NMS-12332](https://issues.opennms.org/browse/NMS-12332): SSLCertMonitor server-name parameter results in NPE
- [NMS-12605](https://issues.opennms.org/browse/NMS-12605): Provisiond accepts multiple primary SNMP interfaces
- [NMS-12679](https://issues.opennms.org/browse/NMS-12679): Update database and send events only on status changes
- [NMS-12687](https://issues.opennms.org/browse/NMS-12687): Confd templates for Minion configuration (Karaf)
- [NMS-12699](https://issues.opennms.org/browse/NMS-12699): Bump Docker base dependencies in build-env and OCI artifacts
- [NMS-12710](https://issues.opennms.org/browse/NMS-12710): Create SQL index for optimizing poll result lookups
- [NMS-12718](https://issues.opennms.org/browse/NMS-12718): The Alarm History feature is not working
- [NMS-12723](https://issues.opennms.org/browse/NMS-12723): Events forwarded by Kafka Producer doesn't have any parameters set