Changed

• User interface
  • Submission comments scraping parameters have changed due to the improvements made in this pull request.
    • Structured comments is now the default format.
      • Users will have to include the new --raw flag to export to raw format.
    • Both structured and raw formats can now scrape all comments from a submission.
• Source code
  • The submission comments JSON file's structure has been modified to fit the new submission_metadata dictionary. "data" is now a dictionary that contains the submission metadata dictionary and scraped comments list. Comments are now stored in the "comments" field within "data".
  • Exporting Redditor or submission comments to CSV is now forbidden.
    • URS will ignore the --csv flag if it is present while trying to use either scraper.
  • The created_utc field for each Subreddit rule is now converted to readable time.
  • requirements.txt has been updated.
    • As of v1.20.0, numpy has dropped support for Python 3.6, which means Python 3.7+ is required for URS.
      • .travis.yml has been modified to exclude Python 3.6. Added Python 3.9 to test configuration.
      • Note: Older versions of Python can still be used by downgrading to numpy<=1.19.5.
  • Reddit object validation block has been refactored.
    • A new reusable module has been defined at the bottom of Validation.py.
  • Urs.py no longer pulls API credentials from Credentials.py as it is now deprecated.
    • Credentials are now read from the .env file.
  • Minor refactoring within Validation.py to ensure an extra Halo line is not rendered on failed credential validation.
• README
  • Updated the Comments section to reflect new changes to comments scraper UI.
• Repository documents
  • Updated How to Get PRAW Credentials.md to reflect new changes.
• Tests
  • Updated CLI usage and examples tests.
  • Updated c_fname() test because submission comments scrapes now follow a different naming convention.

Deprecated

• User interface
  • Specifying 0 comments does not only export all comments to raw format anymore. Defaults to structured format.
• Source code
  • Deprecated many global variables defined in Global.py:
    • eo
    • options
    • s_t
    • analytical_tools
  • Credentials.py has been replaced with the .env file.
  • The LogError.log_login decorator has been deprecated due to the refactor within Validation.py.