Reply to thread

Message

<blockquote data-quote="Cupper" data-source="post: 580" data-attributes="member: 22">Analysis of IP activity for the last 10,000 site requests.Code:tail -10000 access_log | awk &#039;{print $ 1}&#039; | sort | uniq -c | sort -nDistribution of user activity over timeNumber of requests per day:Code:awk &#039;{print $ 4}&#039; access_log | cut -d: -f1 | uniq -cNumber of requests by hour (specify the day):Code:grep &quot;04 / Jun&quot; access_log | cut -d [-f2 | cut -d] -f1 | awk -F: &#039;{print $ 2 &quot;: 00&quot;}&#039; | sort -n | uniq -c<img src="https://sun9-33.userapi.com/impg/c858532/v858532275/1e4e08/mb-i5yksvTY.jpg?size=807x207&amp;quality=96&amp;sign=b41d4156e6a5b9838e1d64b22396282e&amp;type=album" alt="Apache logs (part 3): Programs for analyzing Apache logs, image # 7" class="fr-fic fr-dii fr-draggable " style="" />Number of requests per minute (specify date and time):Code:grep &quot;04 / Jun / 2020: 16&quot; access_log | cut -d [-f2 | cut -d] -f1 | awk -F: &#039;{print $ 2 &quot;:&quot; $ 3}&#039; | sort -nk1 -nk2 | uniq -c | awk &#039;{if ($ 1&gt; 10) print $ 0}&#039;<img src="https://sun9-76.userapi.com/impg/c858532/v858532275/1e4e0f/TneNATYWj30.jpg?size=441x587&amp;quality=96&amp;sign=05fa67c74e8960c3a1cffb8594a99112&amp;type=album" alt="Apache logs (part 3): Programs for analyzing Apache logs, image # 8" class="fr-fic fr-dii fr-draggable " style="" />Total unique visitors:Code:cat access_log | awk &#039;{print $ 1}&#039; | sort | uniq -c | wc -lUnique visitors today:Code:cat access_log | grep `date &#039;+% e /% b /% G`` | awk &#039;{print $ 1}&#039; | sort | uniq -c | wc -lUnique visitors this month:Code:(zcat access_log. * gz &amp;&amp; cat access_log) | grep `date &#039;+% b /% G`` | awk &#039;{print $ 1}&#039; | sort | uniq -c | wc -lUnique visitors for any date:Code:(zcat access_log. * gz &amp;&amp; cat access_log) | grep 04 / Jun / 2020 | awk &#039;{print $ 1}&#039; | sort | uniq -c | wc -lUnique visitors per month:Code:(zcat access_log. * gz &amp;&amp; cat access_log) | grep Jun / 2020 | awk &#039;{print $ 1}&#039; | sort | uniq -c | wc -lPopular on the siteSorted statistics by &quot;number of visitors / requests&quot; &quot;IP addresses of visitors&quot;:Code:cat access_log | awk &#039;{print &quot;requests from&quot; $ 1}&#039; | sort | uniq -c | sortMost popular URLs:Code:cat access_log | awk &#039;{print $ 7}&#039; | sort | uniq -c | sort -rn | head -n 25Monitoring site requests in real timeMonitoring requests in real time:Code:tail -f access_log | awk &#039;{printf (&quot;% - 15s \ t% s \ t% s \ t% s \ n&quot;, $ 1, $ 6, $ 9, $ 7)}&#039;Real-time IP address information:Code:tail -f access_log | awk &#039;{&quot;geoiplookup&quot; $ 1 &quot;| cut -d \\: -f2&quot; | getline geo; printf (&quot;% - 15s \ t% s \ t% s \ t% -20s \ t% s \ n&quot;, $ 1, $ 6, $ 9, geo, $ 7); } &#039;Analysis of IP addressesList of all unique IP addresses:Code:cat access_log | awk &#039;{print $ 1}&#039; | sort | uniqUnique IP addresses with date-time stamp:Code:cat access_log | awk &#039;{print $ 1 &quot;&quot; $ 4}&#039; | sort | uniqUnique IP addresses and browsers:Code:cat access_log | awk &#039;{print $ 1 &quot;&quot; $ 12 &quot;&quot; $ 19}&#039; | sort | uniqUnique IP addresses and OS:Code:cat access_log | awk &#039;{print $ 1 &quot;&quot; $ 13}&#039; | sort | uniqUnique IP addresses, date-time and request method:Code:cat access_log | awk &#039;{print $ 1 &quot;&quot; $ 4 &quot;&quot; &nbsp;uniqUnique IP addresses, date-time and requested URL:Code:cat access_log | awk &#039;{print $ 1 &quot;&quot; $ 4 &quot;&quot; $ 7}&#039; | sort | uniqCommands for checking logs on shared hostingA quick display of the number of requests for each site on your Hostland account (useful when you need to find out which site is causing the increased load, which site consumes the most server resources):Code:while read -r line; do echo ===============; echo $ line; cat $ {line} logs / access_log |</blockquote>

[QUOTE="Cupper, post: 580, member: 22"] Analysis of IP activity for the last 10,000 site requests. Code: tail -10000 access_log | awk '{print $ 1}' | sort | uniq -c | sort -n [B]Distribution of user activity over time[/B] Number of requests per day: Code: awk '{print $ 4}' access_log | cut -d: -f1 | uniq -c Number of requests by hour (specify the day): Code: grep "04 / Jun" access_log | cut -d [-f2 | cut -d] -f1 | awk -F: '{print $ 2 ": 00"}' | sort -n | uniq -c [IMG alt="Apache logs (part 3): Programs for analyzing Apache logs, image # 7"]https://sun9-33.userapi.com/impg/c858532/v858532275/1e4e08/mb-i5yksvTY.jpg?size=807x207&quality=96&sign=b41d4156e6a5b9838e1d64b22396282e&type=album[/IMG] Number of requests per minute (specify date and time): Code: grep "04 / Jun / 2020: 16" access_log | cut -d [-f2 | cut -d] -f1 | awk -F: '{print $ 2 ":" $ 3}' | sort -nk1 -nk2 | uniq -c | awk '{if ($ 1> 10) print $ 0}' [IMG alt="Apache logs (part 3): Programs for analyzing Apache logs, image # 8"]https://sun9-76.userapi.com/impg/c858532/v858532275/1e4e0f/TneNATYWj30.jpg?size=441x587&quality=96&sign=05fa67c74e8960c3a1cffb8594a99112&type=album[/IMG] Total unique visitors: Code: cat access_log | awk '{print $ 1}' | sort | uniq -c | wc -l Unique visitors today: Code: cat access_log | grep `date '+% e /% b /% G`` | awk '{print $ 1}' | sort | uniq -c | wc -l Unique visitors this month: Code: (zcat access_log. * gz && cat access_log) | grep `date '+% b /% G`` | awk '{print $ 1}' | sort | uniq -c | wc -l Unique visitors for any date: Code: (zcat access_log. * gz && cat access_log) | grep 04 / Jun / 2020 | awk '{print $ 1}' | sort | uniq -c | wc -l Unique visitors per month: Code: (zcat access_log. * gz && cat access_log) | grep Jun / 2020 | awk '{print $ 1}' | sort | uniq -c | wc -l [B]Popular on the site[/B] Sorted statistics by "number of visitors / requests" "IP addresses of visitors": Code: cat access_log | awk '{print "requests from" $ 1}' | sort | uniq -c | sort Most popular URLs: Code: cat access_log | awk '{print $ 7}' | sort | uniq -c | sort -rn | head -n 25 [B]Monitoring site requests in real time[/B] Monitoring requests in real time: Code: tail -f access_log | awk '{printf ("% - 15s \ t% s \ t% s \ t% s \ n", $ 1, $ 6, $ 9, $ 7)}' Real-time IP address information: Code: tail -f access_log | awk '{"geoiplookup" $ 1 "| cut -d \\: -f2" | getline geo; printf ("% - 15s \ t% s \ t% s \ t% -20s \ t% s \ n", $ 1, $ 6, $ 9, geo, $ 7); } ' [B]Analysis of IP addresses[/B] List of all unique IP addresses: Code: cat access_log | awk '{print $ 1}' | sort | uniq Unique IP addresses with date-time stamp: Code: cat access_log | awk '{print $ 1 "" $ 4}' | sort | uniq Unique IP addresses and browsers: Code: cat access_log | awk '{print $ 1 "" $ 12 "" $ 19}' | sort | uniq Unique IP addresses and OS: Code: cat access_log | awk '{print $ 1 "" $ 13}' | sort | uniq Unique IP addresses, date-time and request method: Code: cat access_log | awk '{print $ 1 "" $ 4 "" uniq Unique IP addresses, date-time and requested URL: Code: cat access_log | awk '{print $ 1 "" $ 4 "" $ 7}' | sort | uniq [B]Commands for checking logs on shared hosting[/B] A quick display of the number of requests for each site on your Hostland account (useful when you need to find out which site is causing the increased load, which site consumes the most server resources): Code: while read -r line; do echo ===============; echo $ line; cat $ {line} logs / access_log | [/QUOTE]

Name

Verification