microservice chain logger

Text or JSON-formatted logger for microservices with bundled Correlation ID and http-server access logging.

Features:

• wrappers for console.info/warn/error producing a text or JSON inflated with customizable metadata
• access log express middleware with additional metadata provided with the same API
• reading/assigning X-Correlation-ID which is automatically reflected in the log messages (including access logs)

All of the features are optional and you can use only the ones you need.

Install

npm install microservice-chain-logger

Basic example

const logger = require('microservice-chain-logger');
const app = require('express')();

// this initiates firing logger.info on each request
// with basic access log information: user, status code, method, path
app.use(logger.initAccessLog({
  // this (optional) setting tells that access log
  // and ALL OTHER LOGS should use JSON format
  useJsonTransformer: true
}));

app.get('/', (req, res) => {
  // here we use req as the first parameter
  // making it possible to recognize X-Correlation-ID
  // The object req itself will NOT be logged
  logger.info(req, 'root called with headers', req.headers);
  res.send('Hello World');
});

// sample express error handler
app.use((err, req, res, next) => {
  // Here we log a potential exception object (err).
  // It will be automatically recognized as an exception,
  // creating stack, file, line and column fields
  // in the resulting JSON
  logger.error(req, 'there was an error:', err);
  next();
});

app.listen(3000);

// just a normal log, no req needed here,
// since it's not in a HTTP-Request context
logger.info('call: curl http://localhost:3000/');

Please note that the logger is a singleton meaning any changes you make to it by replacing a function would have immediate effect on the entire application.

API

logger.info(), logger.warn(), logger.error(), logger.debug()

These functions correspond to console but also add metadata, e.g. processTime, correlationId and any other data you inject using transformEntry.

The first parameter has a special meaning. If it's an instance of express Request, then it's not logged but used as a context, e.g. as a source for correlationId

app.get('/some/route', (req, res) => {
  logger.info('just some text');
  logger.warn('you', {can: 'mix'}, 'different', ['types', 1337]);
  logger.info(req, 'message with meta data', {from: 'the req'});
});

Note: logger.debug() uses the same console.info() just like logger.info()

logger.infoSource()

Same as logger.info() but adds file, line and column fields referencing the code location where it was called

// outputs "reached this point! in my_file.js:10:2"
logger.infoSource('reached this point!');

logger.initAccessLog(opts)

• opts - Object or undefined

The access log can be used as a replacement for the morgan module, keeping all of the logs in a consistent format and implicitly providing correlationId for each request.

The request duration is automatically measured and stored in the duration field.

// access log will not be triggered for /status
// because it comes BEFORE acess log middleware
app.get('/status', (req, res) => res.send('healthy'));

// register access log middleware
app.use(logger.initAccessLog());

app.get('/', (req, res) => {
  res.send('requests to this and further routes will be logged');
});

Options:

• useJsonTransformer - replace default textTransformer with jsonTransformer function
• maxMessageLength - override default maxMessageLength=8000 for jsonTransformer
• injectIntoReq - automatically create req.logger bound to the request
• assignCorrelationId - automatically assign a new correlationId, if none was provided in headers

// init access log and replace transformEntry
// so that it produces JSON when in production environment
app.use(logger.initAccessLog({
  useJsonTransformer: process.env.NODE_ENV === 'production',
  assignCorrelationId: true
}));

The access log middleware adds a field isAccessLog to the log entry, which is then removed in the default transformEntry. You can use this flag for special logic for messages coming from access log.

logger.getCorrelationId(req)

Returns the value of X-Correlation-ID if provided in the header, otherwise creates a new one using UUID v4.

app.get('/', (req, res) => {
  res.send('correlationId is ' + logger.getCorrelationId(req));
});

Note getCorrelationId() also sets X-Correlation-ID header to current req, thus if called twice it will return the same ID, and if called at least once then the access log will already contain the correlation ID.

logger.assignCorrelationId(req, opts)

Assigns correlationId to request-compatible opts-object. It uses getCorrelationId() internally meaning it has the same side effect on current req.

const request = require('request');
app.get('/', (req, res, next) => {
  request(logger.assignCorrelationid(req, {
    uri: 'http://some.other.service/and/path'
  }))
    .then(() => {
      res.send('correlationId is ' + logger.getCorrelationId(req));
    })
    .catch(next);
});

An alternative way when using superagent:

const superagent = require('superagent');
app.get('/', (req, res, next) => {
  superagent
    .get('http://some.other.service/and/path')
    .set('X-Correlation-ID', logger.getCorrelationId(req))
    .end(function(err, res){
      // Do something
    });
});

Hacking API

For the most of the cases you should be fine with the functions above, but feel free to hack the library at your on risk.

logger.logFunctions property

logger.logFunctions is an object consisting of {info, warn, error, debug}

These functions can be used to override default core logging functions (default core logging functions are console.info, console.debug, console.warn and console.error).

You can either replace single functions, e.g.;

logger.logFunctions.error = (error) => { /* ... send email ... */ };

... or replace the entire logger.logFunctions object.

see an example

logger.transformEntry(func, entry)

Params:

• func - console logging function such as console.info/warn/error
• entry - the object containing the message and metadata to be logged

Returns String or undefined.

Returning undefined skips the current message.

Replacing this function allows customizing the log format and log filtering. By default a text transformer is used (logger.textTransformer). The text transformer supports displaying the following fields:

• processTime
• message
• stack
• file, line, column
• duration

// switch to JSON transformer instead
logger.transformEntry = logger.jsonTransformer;

// custom text transformer
logger.transformEntry = (func, entry) => {
  // suppress info logging, but keep access logs
  if (!entry.isAccessLog && func === console.info) {
    return;
  }

  // output logs as text instead of JSON
  return entry.processTime + ' ' + entry.message;
};

logger.makeEntry(req, ...messages)

Params:

• req - express Request or null
• ...messages - mixed

Returns Object.

Replacing this function allows you to alter metadata injection, on the step BEFORE transformEntry, e.g. if you want to inject something from req other than just correlationId

// extend makeEntry(), so that each record also includes HTTP method
const origianlMakeEntry = logger.makeEntry;
logger.makeEntry = (req, ...messages) => {
  const result = origianlMakeEntry(req, ...messages);
  if (req) {
    result.method = req.method;
  }
  return result;
};

logger.applyLogFunction(func, entry)

Params:

• func - one of the loging functions: console.info, console.warn or console.error
• entry - message object

The unferlying function for logger.info/warn/error working with the logging object instead of trying to format mixed parameters as a single message string. It will NOT call makeEntry, so if you need the context just call makeEntry explicitly to prepare the initial entry.

You can use it to inject specific custom fields directly from your code. Most likely you want to set at least message and processTime properties to keep it consistent with the rest of the library.

logger.applyLogFunction(console.info, {
  message: "balloon started",
  color: "blue",
  size: "medium",
  processTime: (new Date()).toISOString()
});

... and yes, you can replace it to match you needs just like other functions above

Using together with kraken.js

Here is a sample of how you can replace the standard morgan access log just by changing the config:

{
  "middleware": {
    "logger": {
      "route": "/((?!metrics|status|favicon.ico|robots.txt))*",
      "priority": 0,
      "module": {
        "name": "microservice-chain-logger",
        "method": "initAccessLog",
        "arguments": [
          {
            "useJsonTransformer": true
          }
        ]
      }
    }
  }
}

... you may want to move the arguments part to production.json, so that you get JSON in production environment only.

More examles

...See more advanced examples on github

License

MIT