2024-10-16 11:04:14,330 - satellite_download_logger - ERROR - Could not save metasdata for LANDSAT/LC08/C02/T1_TOA/LC08_072086_20240824 that failed. Failed to open the image file data/nzd0188/L8/ms/2024-08-24-21-59-36_L8_nzd0188_ms.tif 2024-10-16 11:04:18,896 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC08/C02/T1_TOA/LC08_072086_20240925 as 2024-09-25-21-59-43_L8_nzd0188_ms.tif 2024-10-16 11:04:24,230 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC08/C02/T1_TOA/LC08_073085_20240831 as 2024-08-31-22-05-27_L8_nzd0188_ms.tif 2024-10-16 11:04:30,463 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC08/C02/T1_TOA/LC08_073085_20240916 as 2024-09-16-22-05-33_L8_nzd0188_ms.tif 2024-10-16 11:04:37,108 - satellite_download_logger - ERROR - Could not save metasdata for LANDSAT/LC08/C02/T1_TOA/LC08_073086_20240815 that failed. Failed to open the image file data/nzd0188/L8/ms/2024-08-15-22-05-43_L8_nzd0188_ms.tif 2024-10-16 11:04:41,935 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC08/C02/T1_TOA/LC08_073086_20240831 as 2024-08-31-22-05-51_L8_nzd0188_ms.tif 2024-10-16 11:04:47,373 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC08/C02/T1_TOA/LC08_073086_20240916 as 2024-09-16-22-05-57_L8_nzd0188_ms.tif 2024-10-16 11:04:50,804 - satellite_download_logger - ERROR - Could not save metasdata for LANDSAT/LC08/C02/T1_TOA/LC08_073086_20241002 that failed. Failed to open the image file data/nzd0188/L8/ms/2024-10-02-22-05-53_L8_nzd0188_ms.tif 2024-10-16 11:04:57,322 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC09/C02/T1_TOA/LC09_072086_20240901 as 2024-09-01-21-59-36_L9_nzd0188_ms.tif 2024-10-16 11:05:00,816 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC09/C02/T1_TOA/LC09_072086_20240917 as 2024-09-17-21-59-40_L9_nzd0188_ms.tif 2024-10-16 11:05:07,560 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC09/C02/T1_TOA/LC09_072086_20241003 as 2024-10-03-21-59-47_L9_nzd0188_ms.tif 2024-10-16 11:05:13,055 - satellite_download_logger - ERROR - Could not save metasdata for LANDSAT/LC09/C02/T1_TOA/LC09_073086_20240807 that failed. Failed to open the image file data/nzd0188/L9/ms/2024-08-07-22-05-32_L9_nzd0188_ms.tif 2024-10-16 11:05:21,497 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC09/C02/T1_TOA/LC09_073086_20240908 as 2024-09-08-22-05-48_L9_nzd0188_ms.tif 2024-10-16 11:05:27,901 - satellite_download_logger - INFO - Successfully downloaded image id LANDSAT/LC09/C02/T1_TOA/LC09_073086_20240924 as 2024-09-24-22-05-49_L9_nzd0188_ms.tif 2024-10-16 11:05:32,314 - satellite_download_logger - ERROR - Could not save metasdata for LANDSAT/LC09/C02/T1_TOA/LC09_073086_20241010 that failed. Failed to open the image file data/nzd0188/L9/ms/2024-10-10-22-05-58_L9_nzd0188_ms.tif 2024-10-16 11:05:32,341 - satellite_download_logger - INFO - Please read the following information carefully: 2024-10-16 11:05:32,341 - satellite_download_logger - INFO - find_wl_contours2: A method for extracting shorelines that uses the sand water interface detected with the model to refine the threshold that's used to detect shorelines . - This is the default method used when there are enough sand pixels within the reference shoreline buffer. 2024-10-16 11:05:32,341 - satellite_download_logger - INFO - find_wl_contours1: This shoreline extraction method uses a threshold to differentiate between water and land pixels in images, relying on Modified Normalized Difference Water Index (MNDWI) values. However, it may inaccurately classify snow and ice as water, posing a limitation in certain environments. - This is only used when not enough sand pixels are detected within the reference shoreline buffer. 2024-10-16 11:05:32,341 - satellite_download_logger - INFO - --------------------------------------------------------------------------------------------------------------------- 2024-10-16 11:05:32,343 - satellite_download_logger - INFO - Extracting shorelines for L5 Minimum Shoreline Length: 500 2024-10-16 11:05:32,344 - satellite_download_logger - INFO - WARNING: CoastSat has hard-coded the value for the minimum shoreline length for L7 to 200 2024-10-16 11:05:32,344 - satellite_download_logger - INFO - Extracting shorelines for L7 Minimum Shoreline Length: 200 2024-10-16 11:05:32,346 - satellite_download_logger - INFO - Extracting shorelines for L8 Minimum Shoreline Length: 500 2024-10-16 11:05:32,375 - satellite_download_logger - ERROR - Skipping L8 2024-07-30-22-05-15 due to cloud cover percentage exceeding cloud threshold: 73.78% > 10.00%. 2024-10-16 11:05:32,420 - satellite_download_logger - ERROR - Skipping L8 2024-07-30-22-05-39 due to cloud cover percentage exceeding cloud threshold: 32.48% > 10.00%. 2024-10-16 11:05:32,507 - satellite_download_logger - ERROR - Skipping L8 2024-08-08-21-59-24 due to cloud cover percentage exceeding cloud threshold: 17.15% > 10.00%. 2024-10-16 11:05:32,510 - satellite_download_logger - INFO - Processing image L8 2024-08-31-22-05-27 2024-10-16 11:05:32,510 - satellite_download_logger - INFO - L8 2024-08-31-22-05-27 cloud cover : 0.00% 2024-10-16 11:05:32,561 - satellite_download_logger - INFO - L8 2024-08-31-22-05-27: sand: 0.00% ,whitewater: 0.00% ,water: 42.54% 2024-10-16 11:05:32,562 - satellite_download_logger - INFO - L8 2024-08-31-22-05-27: Less than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours1 2024-10-16 11:05:32,563 - satellite_download_logger - ERROR - L8 2024-08-31-22-05-27: Could not map shoreline due to error no valid pixels found in reference shoreline buffer. Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.10/site-packages/coastsat/SDS_shoreline.py", line 626, in extract_shorelines contours_mwi, t_mndwi = find_wl_contours1( File "/home/ubuntu/.local/lib/python3.10/site-packages/coastsat/SDS_shoreline.py", line 921, in find_wl_contours1 raise ValueError("no valid pixels found in reference shoreline buffer.") ValueError: no valid pixels found in reference shoreline buffer. 2024-10-16 11:05:32,581 - satellite_download_logger - INFO - Processing image L8 2024-08-31-22-05-51 2024-10-16 11:05:32,581 - satellite_download_logger - INFO - L8 2024-08-31-22-05-51 cloud cover : 5.93% 2024-10-16 11:05:32,673 - satellite_download_logger - INFO - L8 2024-08-31-22-05-51: sand: 2.73% ,whitewater: 3.03% ,water: 40.69% 2024-10-16 11:05:32,674 - satellite_download_logger - INFO - L8 2024-08-31-22-05-51: Greater than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours2 2024-10-16 11:05:32,678 - satellite_download_logger - INFO - Number of shorelines before removing shorelines < 500m: 9 shorelines. Number of shorelines after filtering shorelines: 1 shorelines 2024-10-16 11:05:32,678 - satellite_download_logger - INFO - Number of shoreline points before removing points within 300m of cloud mask 112 2024-10-16 11:05:32,682 - satellite_download_logger - INFO - Number of shoreline points after removing points within 300m of cloud mask 85 2024-10-16 11:05:32,682 - satellite_download_logger - INFO - Number of shoreline points before removing points within 30m of no data pixel 85 2024-10-16 11:05:32,684 - satellite_download_logger - INFO - Number of shoreline points after removing points within 30m of no data pixel 85 2024-10-16 11:05:32,963 - satellite_download_logger - INFO - Processing image L8 2024-09-16-22-05-33 2024-10-16 11:05:32,963 - satellite_download_logger - INFO - L8 2024-09-16-22-05-33 cloud cover : 0.00% 2024-10-16 11:05:32,979 - satellite_download_logger - INFO - L8 2024-09-16-22-05-33: sand: 0.00% ,whitewater: 0.00% ,water: 37.53% 2024-10-16 11:05:32,979 - satellite_download_logger - INFO - L8 2024-09-16-22-05-33: Less than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours1 2024-10-16 11:05:32,980 - satellite_download_logger - ERROR - L8 2024-09-16-22-05-33: Could not map shoreline due to error no valid pixels found in reference shoreline buffer. Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.10/site-packages/coastsat/SDS_shoreline.py", line 626, in extract_shorelines contours_mwi, t_mndwi = find_wl_contours1( File "/home/ubuntu/.local/lib/python3.10/site-packages/coastsat/SDS_shoreline.py", line 921, in find_wl_contours1 raise ValueError("no valid pixels found in reference shoreline buffer.") ValueError: no valid pixels found in reference shoreline buffer. 2024-10-16 11:05:32,986 - satellite_download_logger - INFO - Processing image L8 2024-09-16-22-05-57 2024-10-16 11:05:32,986 - satellite_download_logger - INFO - L8 2024-09-16-22-05-57 cloud cover : 0.00% 2024-10-16 11:05:33,029 - satellite_download_logger - INFO - L8 2024-09-16-22-05-57: sand: 0.00% ,whitewater: 1.51% ,water: 40.37% 2024-10-16 11:05:33,030 - satellite_download_logger - INFO - L8 2024-09-16-22-05-57: Less than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours1 2024-10-16 11:05:33,032 - satellite_download_logger - INFO - Number of shorelines before removing shorelines < 500m: 7 shorelines. Number of shorelines after filtering shorelines: 1 shorelines 2024-10-16 11:05:33,033 - satellite_download_logger - INFO - Number of shoreline points before removing points within 300m of cloud mask 165 2024-10-16 11:05:33,033 - satellite_download_logger - INFO - Number of shoreline points after removing points within 300m of cloud mask 165 2024-10-16 11:05:33,033 - satellite_download_logger - INFO - Number of shoreline points before removing points within 30m of no data pixel 165 2024-10-16 11:05:33,035 - satellite_download_logger - INFO - Number of shoreline points after removing points within 30m of no data pixel 165 2024-10-16 11:05:33,371 - satellite_download_logger - ERROR - Skipping L8 2024-09-25-21-59-43 due to cloud cover percentage exceeding cloud threshold: 52.64% > 10.00%. 2024-10-16 11:05:33,373 - satellite_download_logger - INFO - Extracting shorelines for L9 Minimum Shoreline Length: 500 2024-10-16 11:05:33,377 - satellite_download_logger - INFO - Processing image L9 2024-09-01-21-59-36 2024-10-16 11:05:33,377 - satellite_download_logger - INFO - L9 2024-09-01-21-59-36 cloud cover : 0.00% 2024-10-16 11:05:33,441 - satellite_download_logger - INFO - L9 2024-09-01-21-59-36: sand: 3.62% ,whitewater: 2.82% ,water: 47.05% 2024-10-16 11:05:33,441 - satellite_download_logger - INFO - L9 2024-09-01-21-59-36: Greater than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours2 2024-10-16 11:05:33,445 - satellite_download_logger - INFO - Number of shorelines before removing shorelines < 500m: 8 shorelines. Number of shorelines after filtering shorelines: 1 shorelines 2024-10-16 11:05:33,445 - satellite_download_logger - INFO - Number of shoreline points before removing points within 300m of cloud mask 163 2024-10-16 11:05:33,445 - satellite_download_logger - INFO - Number of shoreline points after removing points within 300m of cloud mask 163 2024-10-16 11:05:33,445 - satellite_download_logger - INFO - Number of shoreline points before removing points within 30m of no data pixel 163 2024-10-16 11:05:33,448 - satellite_download_logger - INFO - Number of shoreline points after removing points within 30m of no data pixel 163 2024-10-16 11:05:33,781 - satellite_download_logger - INFO - Processing image L9 2024-09-08-22-05-48 2024-10-16 11:05:33,781 - satellite_download_logger - INFO - L9 2024-09-08-22-05-48 cloud cover : 0.00% 2024-10-16 11:05:33,892 - satellite_download_logger - INFO - L9 2024-09-08-22-05-48: sand: 2.99% ,whitewater: 0.01% ,water: 54.05% 2024-10-16 11:05:33,893 - satellite_download_logger - INFO - L9 2024-09-08-22-05-48: Greater than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours2 2024-10-16 11:05:33,896 - satellite_download_logger - INFO - Number of shorelines before removing shorelines < 500m: 4 shorelines. Number of shorelines after filtering shorelines: 2 shorelines 2024-10-16 11:05:33,896 - satellite_download_logger - INFO - Number of shoreline points before removing points within 300m of cloud mask 209 2024-10-16 11:05:33,896 - satellite_download_logger - INFO - Number of shoreline points after removing points within 300m of cloud mask 209 2024-10-16 11:05:33,896 - satellite_download_logger - INFO - Number of shoreline points before removing points within 30m of no data pixel 209 2024-10-16 11:05:33,910 - satellite_download_logger - INFO - Number of shoreline points after removing points within 30m of no data pixel 209 2024-10-16 11:05:34,314 - satellite_download_logger - ERROR - Skipping L9 2024-09-17-21-59-40 due to cloud cover percentage exceeding cloud threshold: 81.75% > 10.00%. 2024-10-16 11:05:34,327 - satellite_download_logger - INFO - Processing image L9 2024-09-24-22-05-49 2024-10-16 11:05:34,327 - satellite_download_logger - INFO - L9 2024-09-24-22-05-49 cloud cover : 0.00% 2024-10-16 11:05:34,457 - satellite_download_logger - INFO - L9 2024-09-24-22-05-49: sand: 3.43% ,whitewater: 0.00% ,water: 49.43% 2024-10-16 11:05:34,458 - satellite_download_logger - INFO - L9 2024-09-24-22-05-49: Greater than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours2 2024-10-16 11:05:34,472 - satellite_download_logger - INFO - Number of shorelines before removing shorelines < 500m: 4 shorelines. Number of shorelines after filtering shorelines: 1 shorelines 2024-10-16 11:05:34,473 - satellite_download_logger - INFO - Number of shoreline points before removing points within 300m of cloud mask 163 2024-10-16 11:05:34,473 - satellite_download_logger - INFO - Number of shoreline points after removing points within 300m of cloud mask 163 2024-10-16 11:05:34,473 - satellite_download_logger - INFO - Number of shoreline points before removing points within 30m of no data pixel 163 2024-10-16 11:05:34,475 - satellite_download_logger - INFO - Number of shoreline points after removing points within 30m of no data pixel 163 2024-10-16 11:05:34,881 - satellite_download_logger - INFO - Processing image L9 2024-10-03-21-59-47 2024-10-16 11:05:34,881 - satellite_download_logger - INFO - L9 2024-10-03-21-59-47 cloud cover : 0.00% 2024-10-16 11:05:34,963 - satellite_download_logger - INFO - L9 2024-10-03-21-59-47: sand: 3.30% ,whitewater: 10.09% ,water: 44.92% 2024-10-16 11:05:34,963 - satellite_download_logger - INFO - L9 2024-10-03-21-59-47: Greater than 50 sand pixels detected within reference shoreline buffer. Using find_wl_contours2 2024-10-16 11:05:34,966 - satellite_download_logger - INFO - Number of shorelines before removing shorelines < 500m: 3 shorelines. Number of shorelines after filtering shorelines: 2 shorelines 2024-10-16 11:05:34,966 - satellite_download_logger - INFO - Number of shoreline points before removing points within 300m of cloud mask 207 2024-10-16 11:05:34,966 - satellite_download_logger - INFO - Number of shoreline points after removing points within 300m of cloud mask 207 2024-10-16 11:05:34,966 - satellite_download_logger - INFO - Number of shoreline points before removing points within 30m of no data pixel 207 2024-10-16 11:05:34,985 - satellite_download_logger - INFO - Number of shoreline points after removing points within 30m of no data pixel 207