What a year this has been for Logz.io! It’s been an event-packed year for both our users and our community, with a myriad of new capabilities and product features rolled out one after the other.
We’ve done the best to update you on the major new additions and have also added a What’s New feature within the UI itself to make sure you don’t miss on the new goodies being introduced.
Still, the end of the year is a great opportunity for a recap and in this article, I’d like to highlight the top 10 announcements in 2018. Please note that the list below is not ordered by importance and does not include ALL the news.
#1 – Live Tail 2.0
Replacing tail -f, Live Tail allows you to see your logs streaming into the system in real time. Live Tail was announced in 2017 and has since been widely adopted by our users to troubleshoot issues and measure the impact of new code deployments.
In 2018, we’ve enhanced this feature by adding two new capabilities. First, users can now view the logs in a parsed state as well. Second, they can improve the way these logs are displayed by adding fields and using Kibana-like filters.
#2 – Alice Slack bot
We are a ChatOps-driven organization and so are many of our users. In 2018, we introduced a new Slack bot called Alice which allows you to query Elasticsearch, view Kibana dashboards, and plenty more right from within your own Slack org.
Alice is based on Logz.io’s public API and we intend to add support for more and more API methods in the near future.
You can read more about Alice here.
#3 – Security Analytics
Logz.io Security Analytics is a security app that we’ve built on top of the ELK Stack that allows you to apply the same procedures used for monitoring and troubleshooting your environment, for securing it as well.
Based on the same data set used for operations, this app includes threat detection, correlations, security dashboards and integrations, and more.
More about Logz.io Security Analytics can be found in this article.
#4 – Apollo and Sawmill
Logz.io is built on top of two of the world’s most popular open source monitoring platforms — the ELK Stack and Grafana. We understand the importance of giving back to the open source community, and in 2018 we open sourced two projects that are used in our architecture — Sawmill and Apollo.
- Sawmill is a Java Library that enables data processing, enrichments, filtering, /and transformations. After some hard-earned lessons from using Logstash, Logz.io developed and implemented Sawmill in our data ingestion pipelines to ensure reliable and stable data ingestion.
- Apollo is a Continuous Deployment tool for deploying containers using Kubernetes, and was developed to help Logz.io continuously deploy components of our ELK-based architecture into production.
#5 Logz.io Community
Other major 2018 news is the Logz.io Community on Slack which we announced in July.
The community, now numbering over 800 members, aims at providing its members with the tools to learn from peers, share knowledge and skills, and stay up-to-date with the latest monitoring and logging news from Logz.io and from the online community.
We’re super-thrilled to see this community slowly grow and would love to see you join the party if you haven’t already. You can register here.
Markers is a capability added to our AI-powered Insights feature. Both Cognitive Insights and Application Insights help users deal with the “finding a needle in the haystack” challenge by using machine learning and crowdsourcing to surface critical issues that would otherwise have gone unnoticed. The new Markers feature takes it up a notch by enabling users to understand the context in which these events are taking place.
Users can use a query to signify that an event has taken place and create a marker. This marker can then be plotted on the storyline graph to allows users to more easily identify a correlation between this event and the Insights identified and flagged by Logz.io.
#7 Logz.io Academy and Online Docs
The Academy contains courses and webinars that will guide our users on their Logz.io journey. From the basics, through parsing and creating visualizations, users will find useful practical information to help them make the most out of the data shipped to Logz.io.
Our new docs contain technical information on the product’s main features and how to use them, including an extensive API guide which includes examples and detailed usage instructions.
#8 Account Management
We revamped the account management page (Settings → Manage Account) to give users more control and supervision over how much data is being shipped with two new advanced account settings.
Each account now has the option to save account utilization metrics on a set schedule (every 10, 30 or 60 mins). These metrics include the used data volume for the account as well as the expected data volume for the current indexing rate. Once recorded, you can use these metrics to manage your Logz.io environment more actively — create an alert should a certain threshold be exceeded or create a dashboard monitoring your data volumes.
# 9 UI and UX
Kibana is a great tool and over the years we’ve developed a series of features on top of it to ensure our users can easily analyze their data.
2018 included many new usability enhancements, including an upgrade to Kibana 6 (easier search and filtering), a new account selector for filtering the data in the Discover page per subaccount, a What’s New pane for receiving updates on new features, brand new pages for alerts and optimizer configurations, and plenty more.
#10 Time Series Analytics (Early Availability)
I love ending a meal with a sweet course. At re:Invent we announced the early availability of our Time Series Analytics app.
Built on top of Grafana, this app was designed for collecting, storing and analyzing metrics. Users can now monitor and troubleshoot their applications and the infrastructure they are deployed on using Kibana and Grafana, side-by-side. Dedicated accounts for cost-efficient storage will allow users to store metrics for extended retention periods.
The app is in Early Availability mode, and you can read more about it here.
Logz.io’s goal is to empower engineers to monitor, troubleshoot and secure their applications and services more efficiently by providing a scalable and intelligent machine data analytics platform built on top of open source.
The new features and announcements we made during 2018 is one more step in achieving this goal. Looking forward into 2019, there are a lot of exciting new features on the roadmap and we will be sure to share the news as it becomes available.
We rely on your input to make our platform even better so feel free to drop us a line with ideas, comments, and feedback.
Happy new year!