klotz: logs*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

  1. append - to append the search result of one search with another (new search with/without same number/name of fields) search.
    Usually to append final result of two searches using different method to arrive to the result (which can't be merged into one search)

    appendpipe - to append the search results of post process (subpipeline) of the current resultset to current result set.
    Typically to add summary of the current result set.

    appendcols - to append the fields of one search result with other search result. Fields are added row-wise, 1st row of first search will be merged with 1st row of 2nd search.
    Value of common fields between results will be overwritten by 2nd search result values.
    Typically to show comparitive analysis of two search results in same table/chart.
  2. Extract the 11 elements from each log

    def map_log(line):
    match = re.search('^(S+) (S+) (S+) (S+) [- » (d{4})] "(S+)s*(S+)s*(S+)s*(+)?s*"* (d{3}) (S+)',line)
    if match is None:
    match = re.search('^(S+) (S+) (S+) (S+) [- » (d{4})] "(S+)s*(+)>*( w/s. » +)s*(S+)s*(d{3})s*(S+)',line)
    return(match.groups())
    parsed_rdd = rdd.map(lambda line: parse_log2(line)).filter(lambda line: line 1 » == 1).map(lambda line : line 0 » )
    parsed_rdd2 = parsed_rdd.map(lambda line: map_log(line))
    2021-04-01 Tags: , , , , , by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: Tags: logs

About - Propulsed by SemanticScuttle