Skip to content

Commit aac7a04

Browse files
pbailiepbailie
authored
[Feature:System] Updated Preferred Name Change Script (#28)
* Update pnc_compile.pl * Update readme.md
1 parent 9c12c56 commit aac7a04

File tree

2 files changed

+71
-54
lines changed

2 files changed

+71
-54
lines changed

‎preferred_name_logging/pnc_compile.pl

+50-37
Original file line numberDiff line numberDiff line change
@@ -5,8 +5,9 @@
55
# Invoke with -y or --yesterday to compile with yesterday's timestamps.
66
# Useful if you run this script overnight starting after 12AM.
77

8-
# Author: Peter Bailie, RPI Research Computing
9-
# Date: April 29, 2022
8+
# Author: Peter Bailie, RPI Research Computing
9+
# Date: April 29, 2022
10+
# Updated: February 7, 2023
1011

1112
use strict;
1213
use warnings;
@@ -28,46 +29,58 @@
2829
open my $psql_fh, "<:encoding(UTF-8)", $PSQL_LOG;
2930
open my $pnc_fh, ">>:encoding(UTF-8)", $PNC_LOG;
3031

31-
my ($timestamp, $userid, $auth) = ("", "", "");
32-
my ($oldfn, $newfn, $oldln, $newln, $line1, $line2);
32+
# fn = firstname/givenname, ln = lastname/familyname
33+
my ($timestamp, $userid, $auth, $oldfn, $newfn, $oldln, $newln, $line1, $line2);
34+
my $regex_check = 1;
3335
while (<$psql_fh>) {
34-
($timestamp, $userid, $oldfn, $newfn, $oldln, $newln) = ($1, $2, $3, $4, $5, $6) if (/^${datestamp} (\d{2}:\d{2}:\d{2}\.\d{3} [A-Z]{3}).+DETAIL: USER_ID: "(.+?)" (?:PREFERRED_FIRSTNAME OLD: "(.*?)" NEW: "(.*?)" )?(?:PREFERRED_LASTNAME OLD: "(.*?)" NEW: "(.*?)")?$/);
35-
$auth = $1 if (/\/\* AUTH: "(.+)" \*\//);
36-
# $auth is always on a different line than $timestamp, $userid.
37-
# But all three having data will indicate we have collected pref name change logs.
38-
if ($timestamp ne "" && $userid ne "" && $auth ne "") {
39-
# $oldfn, $newfn, $oldln, $oldfn -- some may be undefined.
40-
# This happens when either the firstname or lastname change wasn't recorded in PSQL logs (because no change occured).
41-
# Undefined vars need to be defined to prevent 'concatenation by undefned var' warning.
42-
foreach ($oldfn, $newfn, $oldln, $newln) {
43-
$_ = "" if (!defined $_);
36+
if ($regex_check == 1) {
37+
if ($_ =~ m/^${datestamp} (\d{2}:\d{2}:\d{2}\.\d{3} [A-Z]{3}).+LOG: PREFERRED_NAME DATA UPDATE$/) {
38+
$timestamp = $1;
39+
$regex_check = 2;
4440
}
45-
46-
# If both old and new firstnames are blank, no change was logged.
47-
if ($oldfn ne "" || $newfn ne "") {
48-
($oldfn, $newfn) = rpad(19, $oldfn, $newfn);
49-
$line1 = " OLD PREF FIRSTNAME: ${oldfn}";
50-
$line2 = " NEW PREF FIRSTNAME: ${newfn}";
51-
} else {
52-
($line1, $line2) = ("", "");
53-
($line1, $line2) = rpad(41, $line1, $line2);
41+
} elsif ($regex_check == 2) {
42+
if ($_ =~ m/DETAIL: USER_ID: "(.+?)" (?:PREFERRED_GIVENNAME OLD: "(.*?)" NEW: "(.*?)" )?(?:PREFERRED_FAMILYNAME OLD: "(.*?)" NEW: "(.*?)")?/) {
43+
($userid, $oldfn, $newfn, $oldln, $newln) = ($1, $2, $3, $4, $5);
44+
$regex_check = 3;
5445
}
46+
} elsif ($regex_check == 3) {
47+
if ($_ =~ m/\/\* AUTH: "(.+)" \*\//) {
48+
$auth = $1;
5549

56-
# If both old and new lastnames are blank, no change was logged.
57-
if ($oldln ne "" || $newln ne "") {
58-
($oldln, $oldfn) = rpad(19, $oldln, $oldfn);
59-
$line1 .= " OLD PREF LASTNAME: ${oldln}\n";
60-
$line2 .= " NEW PREF LASTNAME: ${newln}\n";
61-
} else {
62-
$line1 .= "\n";
63-
$line2 .= "\n";
64-
}
50+
# $oldfn, $newfn, $oldln, $oldfn -- some may be undefined.
51+
# This happens when either the givenname or familyname change wasn't recorded in PSQL logs (because no change occured).
52+
# Undefined vars need to be defined to prevent 'concatenation by undefned var' warning.
53+
foreach ($oldfn, $newfn, $oldln, $newln) {
54+
$_ = "" if (!defined $_);
55+
}
56+
57+
# If both old and new given names are blank, no change was logged.
58+
if ($oldfn ne "" || $newfn ne "") {
59+
($oldfn, $newfn) = rpad(19, $oldfn, $newfn);
60+
$line1 = " OLD PREF GIVENNAME: ${oldfn}";
61+
$line2 = " NEW PREF GIVENNAME: ${newfn}";
62+
} else {
63+
($line1, $line2) = ("", "");
64+
($line1, $line2) = rpad(41, $line1, $line2);
65+
}
6566

66-
($userid) = rpad(9, $userid);
67-
print $pnc_fh "${datestamp} ${timestamp} USER: ${userid} CHANGED BY: ${auth}\n";
68-
print $pnc_fh $line1;
69-
print $pnc_fh $line2;
70-
($timestamp, $userid, $auth) = ("", "", "");
67+
# If both old and new family names are blank, no change was logged.
68+
if ($oldln ne "" || $newln ne "") {
69+
($oldln, $oldfn) = rpad(19, $oldln, $oldfn);
70+
$line1 .= " OLD PREF FAMILYNAME: ${oldln}\n";
71+
$line2 .= " NEW PREF FAMILYNAME: ${newln}\n";
72+
} else {
73+
$line1 .= "\n";
74+
$line2 .= "\n";
75+
}
76+
77+
($userid) = rpad(9, $userid);
78+
print $pnc_fh "${datestamp} ${timestamp} USER: ${userid} CHANGED BY: ${auth}\n";
79+
print $pnc_fh $line1;
80+
print $pnc_fh $line2;
81+
82+
$regex_check = 1;
83+
}
7184
}
7285
}
7386

‎preferred_name_logging/readme.md

+21-17
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,28 @@
1-
# Preferred Name Logging
1+
# Preferred Name Change Logging
22

3-
## pnc_compile.pl
3+
In the interests of diversity, Submitty provides for users to set a preferred name should it be different from their legal name. This feature can be abused, so changes to a user's preferred name is recorded into Postgresql's log for review. To make it easier to locate these logged messages, a sysadmin tools script, `pnc_compile.pl`, is provided to fetch the preferred name change logs from Postgresql and compile them into a human readable report.
44

5-
This script will help track when user preferred names are changed. It attempts
6-
to compile a report of who made a preferred name change, and what change had
7-
occurred.
5+
**IMPORTANT:** `pnc_compile.pl` needs to operate on a host that can directly access Postgresql's log. Typically, this means the script must be setup on the same server as Postgresql.
86

9-
Submitty provides the preferred name change information in the Postgresql log.
10-
This scipt is used to parse the Postgresql log and create its own report
11-
of preferred name changes that is much more human readable.
7+
1. Make sure your host has Perl 5.30.0 or later.
8+
* Ubuntu 20.04 includes Perl 5.30.0.
9+
2. Retrieve `pnc_compile.pl` from [Github](https://raw.githubusercontent.com/Submitty/SysadminTools/main/preferred_name_logging/pnc_compile.pl) (right click link and choose "Save Link As...")
10+
3. Edit code file to setup its configuration.
11+
* Locate the two lines shown below. They are near the top of the file. These lines dictate where to look for Postgresql's log and where to write the script's compiled log.
12+
* `$PSQL_LOG` dictates where Postgresql's log is located. `$PNC_LOG` dictates where this script will record and append its report.
13+
* The default for `$PSQL_LOG` is set for Postgresql 12 running in Ubuntu 20.04. The default for `$PNC_LOG` will write the script's report to the same directory as the script file.
14+
* Change these values to match your host's setup.
15+
```perl
16+
my $PSQL_LOG = "/var/log/postgresql/postgresql-12-main.log";
17+
my $PNC_LOG = "preferred_name_change_report.log";
18+
```
19+
4. Setup a cron schedule to run the script.
20+
* Postgresql's log is typically owned by `root`, so it is mandatory to run the script as `root`.
21+
* Be sure to set execute permission on the script.
22+
* The script will parse Postgresql's log *by the current day's datestamp*, so it is intended that the script is run once per day.
23+
* Alternatively, if you wish to schedule the crontab for overnight after 12AM, you can set the `-y` or `--yesterday` argument so the script will intentionally parse Postgresql's log by the *previous* day's datestamp. e.g. `/path/to/pnc_compile.pl -y`
1224

13-
This script will parse logs based on a specific datestamp. Since this script
14-
acquires its datestamp based on GMT, it might work best when the postgresql logs
15-
are timestamped in UTC.
16-
17-
This is intended to be run on the postgresql server on at least a daily basis.
18-
Invoke the script with `-y` or `--yesterday` to parse logs with yesterday's
19-
datestamp. That is useful to run the script overnight after 12AM.
20-
21-
## FERPA
25+
# FERPA
2226

2327
Data processed and logged by this tool may be protected by
2428
[FERPA (20 U.S.C. § 1232g)](https://www2.ed.gov/policy/gen/guid/fpco/ferpa/index.html).

0 commit comments

Comments
 (0)