Commits · extractor · Marco Aceti / Tesi

Mar 23, 2023
- Use isoformat instead of timestamp in train export · 46653c89
  Marco Aceti authored 2 years ago
  
  46653c89
- Add geojson station data extractor · 9190d399
  Marco Aceti authored 2 years ago
  
  9190d399
- Add station data extractor · 0f9d1cdc
  Marco Aceti authored 2 years ago
  
  0f9d1cdc
- Refactor train extractor · f5d21f8c
  Marco Aceti authored 2 years ago
  f5d21f8c
Mar 22, 2023
- Merge branch 'master' into extractor · 511c6620
  Marco Aceti authored 2 years ago
  
  511c6620
- Fix train.test_fetch test case · 97d087da
  Marco Aceti authored 2 years ago
  
  97d087da
- Add cli train data extractor and argparse logic · c6768911
  Marco Aceti authored 2 years ago
  
  c6768911
Mar 21, 2023
- Add IncompleTrenordStopDataException · 91b0bca3
  Marco Aceti authored 2 years ago
  
  91b0bca3
Mar 20, 2023
- Remove 'train has not a last stop' debug message · a873a937
  Marco Aceti authored 2 years ago
  a873a937
- Fix _hhmmss_to_dt function · ac3abfa8
  Marco Aceti authored 2 years ago
  ac3abfa8
- Move exceptions to src/scraper/exceptions.py · 39ae9233
  Marco Aceti authored 2 years ago
  
  39ae9233
Mar 16, 2023
- Add date info to parsed Trenord times · 48966dfa
  Marco Aceti authored 2 years ago
  
  48966dfa
- Update Train.client_code at each fetch() · a4cf32a7
  Marco Aceti authored 2 years ago
  
  a4cf32a7
- Handle empty station_ori_name · 9490ab01
  Marco Aceti authored 2 years ago
  9490ab01
- Better handle partially cancelled trains · 703f0b42
  Marco Aceti authored 2 years ago
  703f0b42
- Fetch additional Trenord info · ddd19019
  Marco Aceti authored 2 years ago
  ddd19019
Mar 15, 2023
- Add Trenord API and _trenord_phantom checking · 1487f0a3
  Marco Aceti authored 2 years ago
  
  1487f0a3
- Better handle cancelled trains · ab0ab50c
  Marco Aceti authored 2 years ago
  
  ab0ab50c
- Use pickle instead of jsonpickle · 91598f40
  Marco Aceti authored 2 years ago
  
  91598f40
Mar 14, 2023
- Disable hash seed randomization · e223f22e
  Marco Aceti authored 2 years ago
  
  e223f22e
- Add exc_info to exception logging · 2a72691d
  Marco Aceti authored 2 years ago
  
  2a72691d
- Use .title() to save (phantom) Station names · d13e4f11
  Marco Aceti authored 2 years ago
  
  d13e4f11
Mar 13, 2023
- Log to stdout, not stderr · cb0a173a
  Marco Aceti authored 2 years ago
  
  cb0a173a
- Add HTTP 403 to retry force list · 7af303c2
  Marco Aceti authored 2 years ago
  
  7af303c2
- Include trains of previous day (+- 3 hours) · c74611c4
  Marco Aceti authored 2 years ago
  
  c74611c4
- Handle general exceptions · dfe40fa4
  Marco Aceti authored 2 years ago
  
  dfe40fa4
- Fetch all stations · 1de9d29c
  Marco Aceti authored 2 years ago
  
  1de9d29c
- Add tqdm to unfetched train iteration · bf8cda9f
  Marco Aceti authored 2 years ago
  
  bf8cda9f
- Persist station cache · e2260304
  Marco Aceti authored 2 years ago
  
  e2260304
- Add name info to phantom stations using stop data · d2d59c8b
  Marco Aceti authored 2 years ago
  
  d2d59c8b
- Mark the last stop as last if there isn't one · 5995cfe0
  Marco Aceti authored 2 years ago
  
  5995cfe0
- Add scraper main logic · fa8027a9
  Marco Aceti authored 2 years ago
  
  fa8027a9
- Add Train.arrived() method · 48c0a396
  Marco Aceti authored 2 years ago
  
  48c0a396
- Add Tran.client_code attribute · 0aea15de
  Marco Aceti authored 2 years ago
  
  0aea15de
- Use departing date field instead of computing it · eccbd74b
  Marco Aceti authored 2 years ago
  
  eccbd74b
- Add Train.date() method · 5f41ded9
  Marco Aceti authored 2 years ago
  
  5f41ded9
Mar 12, 2023
- Add __hash__ methods to Station and Train · e9e3b85f
  Marco Aceti authored 2 years ago
  
  e9e3b85f
- Remove useless string from Station.__repr__ · d73c55db
  Marco Aceti authored 2 years ago
  
  d73c55db
- Handle cancelled stops · b56eed84
  Marco Aceti authored 2 years ago
  
  b56eed84
- Add _fetched attribute to Train and repr() support · 9c82264e
  Marco Aceti authored 2 years ago
  
  9c82264e