Activity

  • John Walker posted an update in the group Group logo of UpdatesUpdates 3 weeks, 6 days ago

    2019 July 23

    The clown car is gone!  The clown car is gone!  Now that our
    homebrew rclone backup mechanism is running reliably, I
    deactivated UpdraftPlus, which pushed me over the edge by
    rolling out another update full of dumb FIXES and TWEAKS.  Of
    course, its delete mechanism wants to FTP into our server and
    delete files, which only a moron would allow, so I just deleted
    its plug-in directory myself.
    
    UpdraftPlus either didn't have any tables in the WordPress
    database or the process of running its delete as far as the FTP
    request got rid of them, so there's no additional clean-up of
    the database required.
    
    Committed the deletion of the UpdraftPlus plug-in (Build 337).
    
    Deleted all of the backups created by UpdraftPlus in the
    ratburger.org.backups AWS S3 bucket, a total of 28 files and 7.7
    Gb.  Deleted the ratburger.org.backups bucket itself, removing
    our footprint from the AWS US East (N. Virginia), down the road
    from the NSA.  Deleting an AWS bucket is a little bit like a
    Japanese tea ceremony, but it's gone now.
    
    Updated BuddyPress to version 4.4.0.  This is an incremental
    maintenance and security patch release.  There are no changes to
    user-visible functionality.  There are lots of fixes to escape
    URLs to prevent cross-site scripting attacks.  None of the files
    modified contained any of our local code, so I simply merged the
    local code into the appropriate files in the update release
    which, afterward, were identical with the version already in
    production.  The following files, which contain local code, are
    CSS and JavaScript files where the production version is
    "minified":
        buddypress/bp-templates/bp-legacy/
            css/
                buddypress.css
                buddypress.min.css
            js/
                buddypress.js
                buddypress.min.js
    Since there were no additional changes to these files, to avoid
    the potentially risky process of re-minifying, I simply deleted
    these files and their parent directories from the update kit so
    the versions currently in production will remain in place.
    
    Applied the update kit.  So far, so good.
    
    Starting at 14:14, we have been getting errors like:
        [Tue Jul 23 14:14:48.789136 2019] [proxy_fcgi:error]
            [pid 2490:tid 140051664676608] [client REDACTED:55578]
            AH01071: Got error 'PHP message: PHP Fatal error:
            Allowed memory size of 134217728 bytes exhausted
            (tried to allocate 5738408 bytes) in
            /server/pub/www.ratburger.org/web/wp-content/plugins/wp-external-links/includes/class-wpel-front.php on line 130\n', referer: https://www.ratburger.org/groups/happy-warriors/
        [Tue Jul 23 14:14:48.789200 2019] [proxy_fcgi:error]
            [pid 2490:tid 140051664676608] [client REDACTED:55578]
            AH01071: Got error 'PHP message: PHP Fatal error:
            Unknown: Cannot use output buffering in output buffering
            display handlers in Unknown on line 0\n', referer:
            https://www.ratburger.org/groups/happy-warriors/
        [Tue Jul 23 16:11:25.634873 2019] [proxy_fcgi:error]
            [pid 2489:tid 140051681462016] [client REDACTED:56530]
            AH01071: Got error 'PHP message: PHP Fatal error:  Allowed
            memory size of 134217728 bytes exhausted (tried to allocate
            5864120 bytes) in
            /server/pub/www.ratburger.org/web/wp-content/plugins/really-simple-ssl/class-mixed-content-fixer.php on line 170\n'
        [Tue Jul 23 16:11:25.634933 2019] [proxy_fcgi:error]
            [pid 2489:tid 140051681462016] [client REDACTED:56530]
            AH01071: Got error 'PHP message: PHP Fatal error:
            Unknown: Cannot use output buffering in output buffering
            display handlers in Unknown on line 0\n'
    These have continued to occur sporadically, and always for IPv4
    address REDACTED, never for any other address.  When one
    came up while I was watching, I checked free php_fpm memory on
    the Dashboard and it reported 2,602,128 kB, not vaguely tight.
    Top shows nothing out of the ordinary.
    
    The IP address belongs to user REDACTED, who is accessing the site
    with Safari on an iPad.  Nothing immediately jumps out as odd
    from the access log for this IP address (except for the 500
    status returned for the requests which got the fatal errors).
    
    I tried running one of the request URLs which caused the failure
    both from Chromium on the desktop and Safari on an iPad, and
    both worked just fine.
    
    Checked the user's avatar to see if it might be a huge file that's
    causing problems.  It isn't.
    
    I checked the code referenced in the errors, and it's all
    completely straightforward string functions like preg_replace()
    or str_replace() operating on content being filtered before
    being sent to a user.
    
    Checked the group in which this user had been posting to see if
    somebody had managed to upload a huge file which might be
    causing out of memory conditions.  I saw nothing out of the
    ordinary.
    
    There is nothing of absurd size posted as a post, comment, or
    media upload since well before these errors started to occur.
    
    The BuddyPress 4.4.0 update doesn't seem to have broken anything
    (the mystery of the out of memory errors started hours before
    the update was applied, thank Bob, and wasn't changed by it, so
    it must be unrelated).  I committed the changes (Build 338) and
    published today's changes on GitHub.
    
    • The appearance of Ratburger.org is very different this evening. The pages are squished into half of my screen width, leaving wide bands of unused screen space to the right and left.
      Everything seems to be working normally, but this appearance is annoying.
      I am using the same Chrome browser on an HP laptop that I have been using since Thanksgiving.