Loggly Derived Fields Automatically Inject Intelligence and Structure into Any Log
Custom parsing rules running during log ingestion generate real-time navigable views through Loggly Dynamic Field Explorer, giving all users access to sophisticated log analysis
San Francisco, CA—June 16, 2015—Loggly, the leading cloud-based, enterprise-class log management solution provider, today announced Loggly Derived Fields. This new capability within Loggly Pro and Enterprise allows users to specify custom parsing rules that generate derived fields as metadata during the ingestion process. The derived fields provide intelligence and structure that is then used by Loggly Dynamic Field ExplorerTM; to automatically catalog and summarize logs for one-click navigation and analysis. With derived fields and Field Explorer, development and DevOps teams can troubleshoot problems faster, more effectively monitor their log data for emerging issues, and do sanity checks after code releases without relying on cumbersome, manual queries.
A significant proportion of logs in organizations today are unstructured; the data is not separated into discrete data elements that allow for focused searching or aggregate metrics. Unstructured logs create considerable manual effort for DevOps professionals who traditionally have had to create one-off regular expressions and custom analyses. Many log management solutions require users to develop queries from scratch for each analysis, which is time consuming and inhibits sharing with less technical team members. Derived fields are different because once users create their rules, Loggly automatically applies those rules to all log data it receives, for all users of the account. Any user is then able to use Field Explorer to navigate by field names and values and to create sophisticated analyses without doing any additional work.
Derived fields expand the functionality of the flagship interface of Loggly, Loggly Dynamic Field Explorer. While most traditional log management solutions are designed with the search box as the primary interface, Field Explorer generates navigable lists and summaries to deliver a guided search experience. With Field Explorer, users get a bird’s-eye view of what’s happening, can quickly spot anomalies, understand the magnitude of issues, and search their logs with greater precision. Loggly Derived Fields extend the capabilities of Field Explorer to virtually any log type, structured or unstructured.
Derived fields are metadata, allowing for the original log data to stay intact so that logs can be analyzed in multiple ways. A user may create as many derived fields as needed from the same log events. Derived fields and Dynamic Field Explorer together help DevOps and IT professionals identify and resolve systems issues faster through more flexible and efficient log analytics.
“Loggly is making it even easier for us to use our log data to monitor, troubleshoot, and do sanity checks,” says Igor Ivanov, director of Piper research and development at Icontrol Networks. “With derived fields, we no longer have to refactor our logs to gain advanced insights from them.”
“Loggly Derived Fields have helped Agrian turn previously unstructured log data into query-able, chartable, and actionable information, reducing our reliance on difficult-to-maintain custom scripts and alerting mechanisms,” says Peter Brandt, vice president of engineering at Agrian.
“Unstructured logs are a reality for most cloud-centric companies, yet being able to efficiently mine those logs is critical for troubleshooting and delivering high application responsiveness to the business and end customers,” says Hector Angulo, head of product at Loggly. “Derived fields are another step in our unique ‘summarize first’ strategy. Customers can now gain insight even faster and spend more of their time solving or preventing IT issues rather than finding them.”
Loggly Derived Fields are currently in beta and will be generally available by the end of June 2015. Derived fields are a feature of the Loggly Pro and Enterprise subscription plans.
Loggly aims to empower the creators and operators of cloud-based services to operate flawlessly and deliver great user experiences by knowing what’s going on with their applications and why. Our cloud-based log management solution shows you what matters by crunching through huge volumes of log data that no human could possibly read. Loggly is the world’s most popular cloud-based, enterprise-class log management solution, used by more than 5,000 happy customers. Founded in 2009 and based in San Francisco, the company is backed by Harmony Partners, Trinity Ventures, True Ventures, Matrix Partners, Cisco, Data Collective Venture Capital, and others. Visit us at www.loggly.com or follow @loggly on Twitter.