Skip to content

README.md

Latest commit

 

History

History
25 lines (18 loc) · 1.17 KB

README.md

File metadata and controls

25 lines (18 loc) · 1.17 KB
Raw

How to use CU Course Scrapper?

  • Must have python-3 installed with beautifulsooup4 and selenium webdriver (Chrome Browser) installed as dependencies.
  • Let the requestsOutputScrapper.py run first (takes the longest to run). UI is disabled for the selenium driver and only runs as headless browser.
  • Run the AdvancedStringParser.java file to remove any white spaces and symbols that it might have been scrapped. This is in java which will later be converted into python.
  • Finally to convert the text file to JSON you need to run the TextToJSONConversion.py which will map line by line to a JSON param.

License


Copyright 2020 Sirak Berhane
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

     http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License.