signalfx
v8.0.1
Published
Node.js client library for SignalFx
Downloads
10,160
Readme
ℹ️ SignalFx was acquired by Splunk in October 2019. See Splunk SignalFx for more information.
Node.js client library for SignalFx
This is a programmatic interface in JavaScript for SignalFx's metadata and ingest APIs. It is meant to provide a base for communicating with SignalFx APIs that can be easily leveraged by scripts and applications to interact with SignalFx or report metric and event data to SignalFx.
Installation
To install using npm:
$ npm install signalfx
Supported Node.js versions
| Version | Node.js |
| ------- | --------------- |
| 8.x.x
| >=12.10.0 <=20
|
| 7.4.x
| >=8.0.0 <18
|
| 7.3.1
| >=8.0.0 <11
|
Usage
API access token
To use this library, you need a SignalFx access token. When using the ingest client you will need to specify your organization's access token. For the SignalFlow Client, either an organization access token or a user API token may be used. For more information on access tokens, see the API's Authentication documentation.
Create client
There are two ways to create an ingest client object:
- The default constructor
Ingest
. This constructor uses Protobuf to send data to SignalFx. If it cannot send Protobuf, it falls back to sending JSON. - The JSON constructor
IngestJson
. This constructor uses JSON format to send data to SignalFx.
var signalfx = require("signalfx");
// Create default client
var client = new signalfx.Ingest("ORG_TOKEN", { options });
// or create JSON client
var clientJson = new signalfx.IngestJson("ORG_TOKEN", { options });
Object options
is an optional map and may contains following fields:
- enableAmazonUniqueId - boolean,
false
by default. Iftrue
, library will retrieve Amazon unique identifier and set it asAWSUniqueId
dimension for each datapoint and event. Use this option only if your application deployed to Amazon - dimensions - object, pre-defined dimensions for each datapoint and event. This object has key-value format
{ dimension_name: dimension_value, ...}
- ingestEndpoint - string, custom url to send datapoints in format http://custom.domain/api/path
- timeout - number, sending datapoints timeout in ms (default is 5000ms)
- batchSize - number, batch size to group sending datapoints
- userAgents - array of strings, items from this array will be added to 'user-agent' header separated by comma
- proxy - object, defines an address and credentials for sending metrics through a proxy server, it has the following format:
{ protocol: 'http(s)', host: '127.0.0.1', port: 1234, auth: { username: '<username>', password: '<password>' } },
Configuring the ingest endpoint
If the ingestEndpoint is not set manually, this library uses the us0
realm by default.
If you are not in this realm, you will need to explicitly set the
endpoint urls above. To determine if you are in a different realm and need to
explicitly set the endpoints, check your profile page in the SignalFx
web application.
Reporting data
This example shows how to report metrics to SignalFx, as gauges, counters, or cumulative counters.
var signalfx = require('signalfx');
var client = new signalfx.Ingest('ORG_TOKEN');
client.send({
cumulative_counters:[
{ metric: 'myfunc.calls_cumulative',
value: 10,
timestamp: 1442960607000},
...
],
gauges:[
{ metric: 'myfunc.time',
value: 532,
timestamp: 1442960607000},
...
],
counters:[
{ metric: 'myfunc.calls',
value: 42,
timestamp: 1442960607000},
...
]});
The timestamp
must be a millisecond precision timestamp; the number of milliseconds elapsed since Epoch. The timestamp
field is optional, but strongly recommended. If not specified, it will be set by SignalFx's ingest servers automatically; in this situation, the timestamp of your datapoints will not accurately represent the time of their measurement (network latency, batching, etc. will all impact when those datapoints actually make it to SignalFx).
Sending multi-dimensional data
Reporting dimensions for the data is also optional, and can be accomplished by specifying a dimensions
parameter on each datapoint containing a dictionary of string to string key/value pairs representing the dimensions:
var signalfx = require('signalfx');
var client = new signalfx.Ingest('ORG_TOKEN');
client.send({
cumulative_counters:[
{ 'metric': 'myfunc.calls_cumulative',
'value': 10,
'dimensions': {'host': 'server1', 'host_ip': '1.2.3.4'}},
...
],
gauges:[
{ 'metric': 'myfunc.time',
'value': 532,
'dimensions': {'host': 'server1', 'host_ip': '1.2.3.4'}},
...
],
counters:[
{ 'metric': 'myfunc.calls',
'value': 42,
'dimensions': {'host': 'server1', 'host_ip': '1.2.3.4'}},
...
]});
Sending events
Events can be send to SignalFx via the sendEvent
function. The
event param objects must be specified. Event
param object is an optional map and may contains following fields:
- eventType (string) - Required field. The event type (name of the event time series).
- category (int) - the category of event. Choose one from EVENT_CATEGORIES list.
Different categories of events are supported.Available categories of events are
USER_DEFINED
,ALERT
,AUDIT
,JOB
,COLLECTD
,SERVICE_DISCOVERY
,EXCEPTION
. For mode details seeproto/signal_fx_protocol_buffers.proto
file. Value by default isUSER_DEFINED
- dimensions (dict) - a map of event dimensions, empty dictionary by default
- properties (dict) - a map of extra properties on that event, empty dictionary by default
- timestamp (int64) - a timestamp, by default is current time
Also please specify event category: for that get
option from dictionary
client.EVENT_CATEGORIES
.
var signalfx = require("signalfx");
var client = new signalfx.Ingest("ORG_TOKEN");
client.sendEvent({
category: "[event_category]",
eventType: "[event_type]",
dimensions: {
host: "myhost",
service: "myservice",
instance: "myinstance",
},
properties: {
version: "event_version",
},
timestamp: timestamp,
});
Examples
Complete code example for Reporting data
var signalfx = require("signalfx");
var myToken = "ORG_TOKEN";
var client = new signalfx.Ingest(myToken);
var gauges = [
{
metric: "test.cpu",
value: 10,
},
];
var counters = [
{
metric: "cpu_cnt",
value: 2,
},
];
client.send({ gauges: gauges, counters: counters });
Complete code example for Sending events
var signalfx = require("signalfx");
var myToken = "[ORG_TOKEN]";
var client = new signalfx.Ingest(myToken);
var eventCategory = client.EVENT_CATEGORIES.USER_DEFINED;
var eventType = "deployment";
var dimensions = {
host: "myhost",
service: "myservice",
instance: "myinstance",
};
var properties = { version: "[EVENT-VERSION]" };
client.sendEvent({
category: eventCategory,
eventType: eventType,
dimensions: dimensions,
properties: properties,
});
See example/general_usage.js
for a complete code example for Reporting data.
Set your SignalFx token and run example
$ SPLUNK_ACCESS_TOKEN=xxx SPLUNK_REALM=xxx node example/general_usage.js
Log level
The default log level is info
.
You can override it by setting SFX_CLIENT_LOG_LEVEL
environment variable. Valid values are winston log levels: error
, warn
, info
, http
, verbose
, debug
and silly
.
SignalFlow API
SignalFlow is SignalFx's real-time analytics computation language. The SignalFlow API allows SignalFx users to execute real-time streaming analytics computations on the SignalFx platform. For more information, head over to our Developers documentation:
API access token
The SignalFlow cilent accepts either an Organization Access Token or a User API Token. For more information on access tokens, see the API's Authentication Documentation.
SignalFlow
Configuring the Signalflow websocket endpoint
If the websocket endpoint is not set manually, this library uses the us0
realm by default.
If you are not in this realm, you will need to explicitly set the
endpoint urls above. To determine if you are in a different realm and need to
explicitly set the endpoints, check your profile page in the SignalFx
web application.
Examples
Complete code example for executing a computation
var signalfx = require('signalfx');
var wsCallback = function(evt) {
console.log('Hello, I'm a custom callback: ' + evt);
}
var myToken = '[ACCESS_TOKEN]';
var options = {'signalflowEndpoint': 'wss://stream.{REALM}.signalfx.com',
'apiEndpoint': 'https://api.{REALM}.signalfx.com',
'webSocketErrorCallback': wsCallback
};
var client = new signalfx.SignalFlow(myToken, options);
var handle = client.execute({
program: "data('cpu.utilization').mean().publish()",
start: Date.now() - 60000,
stop: Date.now() + 60000,
resolution: 10000,
immediate: false});
handle.stream(function(err, data) { console.log(data); });
Object options
is an optional map and may contains following fields:
- signalflowEndpoint - string,
wss://stream.us0.signalfx.com
by default. Override this if you are in a different realm thanus0
. - apiEndpoint - string,
https://api.us0.signalfx.com
by default. Override this if you are in a different realm thanus0
. - webSocketErrorCallback - function, Throws an Error event by default. Override this if you want to handle a websocket error differently.
Note: A token created via the REST API is necessary to use this API. API Access tokens intended for ingest are not allowed.
API Options
Parameters to the execute method are as follows :
- program (string) - Required field. The signalflow to be run.
- start (int | string) - A milliseconds since epoch number or a string representing a relative time : e.g. -1h. Defaults to now.
- stop (int | string) - A milliseconds since epoch number or a string representing a relative time : e.g. -30m. Defaults to infinity.
- resolution (int) - The interval across which to calculate, in 1000 millisecond intervals. Defaults to 1000.
- maxDelay (int) - The maximum time to wait for a datapoint to arrive, in 10000 millisecond intervals. Defaults to dynamic.
- bigNumber (boolean) - True if returned values require precision beyond MAX_SAFE_INTEGER. Returns all values in data messages as bignumber objects as per https://www.npmjs.com/package/bignumber.js Defaults to false.
- immediate (boolean) - Whether to adjust the stop timestamp so that the computation doesn't wait for future data to be available.
Computation Objects
The returned object from an execute call possesses the following methods:
- stream (function (err, data)) - accepts a function and will call the function with computation messages when available. It returns multiple types of messages, detailed below. This follows error first callback conventions, so data is returned in the second argument if no errors occurred.
- close () - terminates the computation.
- get_known_tsids () - gets all known timeseries ID's for the current computation
- get_metadata (string) - gets the metadata message associated with the specific timeseries ID.
Stream Message Types
- Metadata
{
type : "metadata",
channel : "<CHID>",
properties : {
sf_key : [<String>]
sf_metric: <String>
...
},
tsId : "<ID>"
}
- Data
{
type : "data",
channel : "<CHID>",
data : [
{
tsId : "<ID>",
value : <Number>
},
...
],
logicalTimestampMs : <Number>
}
- Event
{
tsId : "<ID>",
timestampMs: 1461353198000,
channel: "<CHID>",
type: "event",
properties: {
incidentId: "<ID>",
"inputValues" : "{\"a\":4}",
was: "ok",
is: "anomalous"
}
}
More information about messages can be found at https://developers.signalfx.com/v2/docs/stream-messages-specification
Usage in a Web Browser
The signalflow client can be built for usage in a browser. This is accomplished via the following commands.
$ npm install
$ npm run build:browser
The output can be found at ./build/signalfx.js
It can then be loaded as usual via a script tag
<script src="build/signalfx.js" type="text/javascript"></script>
Once loaded, a signalfx global will be created(window.signalfx). Note that only the SignalFlow package is included in this built file.
Browser Usage Example using D3
First ensure your current working directory is the root of the nodejs repository clone, then do the following :
Make the following changes to example/index.html
replace 'ACCESS_TOKEN' with your own token.
replace 'cpu.utilization' with an appropriate metric as necessary.
Execute the following commands
$ npm install
$ gulp browserify
$ node example/server.js
Finally, open http://localhost:8888/example/index.html
License
Apache Software License v2 © SignalFx