𓆤DBay 𓁛Mirage

Table of Contents generated with DocToc

• 𓆤DBay 𓁛Mirage
  • To Do

𓆤DBay 𓁛Mirage

DBay plugin to mirror, parse and process text files (HTML, CSV, ...) in SQL

This module has been pulled from a preliminary version in dbay-rustybuzz

🚧 Work in progress 🚧

To Do

• table mrg_datasources
  • [–] there might be datasources we do want to import data from without mirroring them, so there should be a flag for that.
  • [–] there may be direct input or results of HTTP queries &cpp so better use URLs instead of file system paths
• HTML: [+] empty lines between paragraphs should be preserved [–] initial blank lines are missing from HTML output [–] what to do for trailing blank lines? [–] tag registry so we can decide whether tag
  • is block
  • allows parsing inside (cf <script>, <code>) [–] run all inserts to mirage HTML in single transaction [–] consider to add CFG to walk_par_rows() to indicate whether to keep or to skip empty/blank lines [–] implement datasources with direct text input [–] in mrg_wspars, use field mrg_*mirror.mat or constant txt = '' instead of function call [+] accept <!doctype> tags (turn into comments)