PopularTagsByCountry

A map generator taking modified nginx logs, turning them into an HTML world map and top 100 lists

This C# and Python hybrid program reads out log files of very large size (~4GB), filters out unwanted tags as declared in the excluded_tags file and turns them into a Plotly choropleth worldmap.

Prerequisites

• For building the project, an installation of Json.NET is required

In the Visual Studio console:

Install-Package Newtonsoft.Json

• You must have Plotly installed for the python choropleth script to run

pip install plotly

Usage

• Neuter and convert the NGINX access log to remove identifiable data and save disk space into JSON as follows:

[ISO 3166-1 alpha-2 code, State abbreviation, Search term(s)]
Example: ["US","NY","mei_(character)"]

• Optional: provide a list of unwanted tags in a file called excluded_tags
• Run the binary in a terminal with the location of your log file as an argument, e.g. in bash:

./PopularTagsByCountry geotags.log

Development

• IDE: Visual Studio 2019
• Languages: C# 8.0, Python 3
• SDK: .NET Core 3.1

Build

1. Clone the repository
2. Open and build in any Visual Studio past version 10.0.40219.1