49a0756 | Zhang Yunjun | 26 June 2019, 14:22:15 UTC | example template for ISCE/stripmapStack | 26 June 2019, 14:30:38 UTC |
f307526 | Zhang Yunjun | 24 June 2019, 19:43:05 UTC | plot_network: fix bug in colormap plot_network: + add --cmap-vlist option to replace the -m, -M and --threshold options. + more robust default color jump utils/plot.plot_network(): use ColormapExt() for the truncate_* colormap directly. modify_network: remove --plot for more simple main() | 24 June 2019, 19:44:12 UTC |
9471a30 | Zhang Yunjun | 19 June 2019, 21:26:33 UTC | assign no-data pixel to zero for ARIA connComp | 19 June 2019, 21:48:05 UTC |
18bfad0 | Zhang Yunjun | 19 June 2019, 19:44:09 UTC | refactoring save_kmz_timeseries 2 + get rid of global variables + use `shutil` and `os` modules to create/move files/directories instead of calling shell commands using os.system() + support full path, so that the script can be ran in other directories. | 19 June 2019, 20:36:50 UTC |
7bcb825 | Andre Theron | 19 June 2019, 20:32:56 UTC | Init of basic snap (BEAM-DIMAP) ingest functionality (#101) + add `prep_snap.py` based on `prep_isce` and `prep_roipac` to extract metadata from interferogram/coherence/unwrapped/elevation .dim (BEAM-DIMAP format) files produced by ESA SNAP and writes a RSC file in ROIPAC format in the same folder as the .dim file. + add `get_ellpsoid_local_radius()` in prep_snap to extract HEIGHT and EARTH_RADIUS from orbit parameters using code adapted and simplified from `isce.isceobj.Planet` in ISCE2. + add `snap` as processor in `load_data`. | 19 June 2019, 20:32:56 UTC |
247461d | Zhang Yunjun | 19 June 2019, 16:15:14 UTC | fix bug of data type while reading isce .conncomp utils/readfile: fix bug while converting byte data type for ISCE file objects/stackDict: change default connectComponent data type from bool to byte (int8) while loading from binary files using load_data.py update comments accordingly | 19 June 2019, 16:24:03 UTC |
6aaafad | Zhang Yunjun | 19 June 2019, 15:10:55 UTC | fix typo in doc for datatype of connectComponent connectComponent is read and saved as np.bool_ format, not int16. | 19 June 2019, 15:18:50 UTC |
dcd8ce1 | Zhang Yunjun | 18 June 2019, 19:19:57 UTC | remove duplicated get_lat_lon() + move get_lat_lon() to utils/utils0.py and remove all the other duplicated copies. + save_kmz_ts*: adjust parsing options | 19 June 2019, 15:18:50 UTC |
9dce3cb | Zhang Yunjun | 18 June 2019, 05:53:32 UTC | refactoring save_kmz_timeseries.py + bug fixed for masking with input --mask file. + add --steps and --lods options to be able to customize the details setup + check file existance and coordinates of input files + add get_aux_filename() for default aux files + adjust split_into_sub_boxes() and get_boxes4deforming_area() to take step as argument instead of win_size + adjust print out message in the terminal + clean the following functions: - create_regionalized_networklinks_file() - generate_network_link() - main() | 18 June 2019, 15:52:19 UTC |
bb5f393 | Zhang Yunjun | 17 June 2019, 16:08:21 UTC | add docs/examples/*/README.md docs/examples + add README file with nbviewer links to notebooks in nbviewer.com for `applications` and `simulations` to load notebook fast on the web docs/resources + remove obsolete pysar logo files save_roipac.py + grab WAVELENGTH metadata only when it's available + if user input custom output filename, use it to determined the FILE_TYPE metadata + get rid of SUBSET_X/YMIN/MAX metadata utils/writefile.py + enforce float32 for DATA_TYPE metadata while writing .trans file + enforce float32 output data type while calling write_float32() view.py + more comments for GPS related example. | 18 June 2019, 01:51:27 UTC |
6178799 | ehavazli | 17 June 2019, 23:09:36 UTC | unit in legend label has been changed from "cm/year" to given unit in the inputs. If no unit is give, the default is still "cm/year" | 18 June 2019, 01:36:17 UTC |
074504e | Scott Staniewicz | 18 June 2019, 01:26:38 UTC | fix mkdir typos in installation.md | 18 June 2019, 01:31:19 UTC |
a9940c4 | Zhang Yunjun | 14 June 2019, 20:18:08 UTC | tsview: support slide using left/right key tsview: add on_key_event() to timeseriesViewer object to support slide image using left and right key on the keyboard, to facilitate detailed interpretation on displacement time-series. add jupyter notebook for image_slider diff: fix bug when ts_file2 has more dates than ts_file1 | 17 June 2019, 16:04:46 UTC |
cde74c5 | ehavazli | 13 June 2019, 23:44:03 UTC | bperp is read from the metadata bperp calculation function and required dirs are removed | 14 June 2019, 01:24:06 UTC |
4b5d684 | Zhang Yunjun | 14 June 2019, 00:54:30 UTC | improved plot_coherence_matrix.py plot_coherence_matrix: + add `--tcoh` option to display temporal coherence of the pixel in the axis title + add `--template` option to not show excluded interferograms due to pixel-wise masking based on coherence during network inversion, so that the upper and lower triangles shows the exact situation used in the network inversion. + add `--cmap-vlist` option to customized truncated colromap tsview: auto transparent map view utils/plot: + class ColormapExt: bug fixed in truncate_* colormaps + plot_coherence_matrix(): support colormap object input in the plot_dict argument | 14 June 2019, 00:57:02 UTC |
9b5c9bd | Zhang Yunjun | 13 June 2019, 15:43:25 UTC | mintpy.residualRms.* --> mintpy.residualRMS.* update google earth link in docs/tutorials/README | 14 June 2019, 00:57:02 UTC |
0d4942a | Zhang Yunjun | 13 June 2019, 22:51:16 UTC | Merge branch 'hfattahi-master' | 13 June 2019, 22:51:16 UTC |
737dd55 | Heresh | 13 June 2019, 22:09:41 UTC | merge with upstream | 13 June 2019, 22:09:41 UTC |
a78b1f3 | Heresh | 13 June 2019, 21:57:26 UTC | fixing the sign of the unwrapped phase | 13 June 2019, 21:57:26 UTC |
3d90ac9 | Zhang Yunjun | 12 June 2019, 18:39:42 UTC | ifg_inv: convert NaN to zero ifgram_inversion: convert all NaN values in phase, coherence and mask data to zero, to avoid RuntimeWarning message during math operation. Since zero is ignored in the inversion, it won't has effect on the result. view: + turn ON reference point display by default for multiple subplots + fix bug of coordinates in status bar for radar coord, as it starts from -0.5 in the UL corner. This is introduced from last commit. + bug fix while showing heigt in coordinates status bar ptime: sorting in read_date_list(), otherwise, it causes unexpected behavior for --ex option in tsview.py | 13 June 2019, 02:17:48 UTC |
2d3d934 | Zhang Yunjun | 12 June 2019, 19:12:56 UTC | readfile: support SNAP BEAM-DIMAP format (#89) * readfile: support SNAP BEAM-DIMAP format utils/readfile: + read_binary(): add positional argument shape, to avoid calling read_attribute() inside, to gain more independence; and adjust its usage in utils/readfile.py and mask.py. + adjust read_attribute() and read_binary_file() to support the following SNAP unw, cor, int and dem data files * add docs/examples/dev/read_snap_img.ipynb * consistent sub-pixel coordinate rule: details in objects/coord.py comments. * reference_point: fix a bug by not using existing REF_Y/X if they are out of the coverage (after subsetting for example). * ifgram_inversion: suppress warning message while calculating mask of Nan and zero phases * update Python version in docs from 3.5 to 3.6. * dem_error: + skip pixel with nan value in any interferogram, instead of in all interferograms before. + ignore input non-existed default exclude_date.txt file * ptime/read_date_list(): support input list contains non-existed text file. * view: shorted coordinates bar | 12 June 2019, 19:12:56 UTC |
5333468 | Zhang Yunjun | 11 June 2019, 00:09:39 UTC | remove gdal>=3.0 from docs/conda.txt (#88) * Update conda.txt * ifg_inv: comment out unused variable Astd * suppress mplDeprecation warning in view.py | 11 June 2019, 00:09:39 UTC |
da4f3dc | Zhang Yunjun | 10 June 2019, 21:01:32 UTC | add cartopy notebook notebook draft of using cartopy for plotting in geo coordinates to replace basemap. It works fine in notebook, but failed when tranferring into *.py script, not clear on the reason yet. | 10 June 2019, 21:03:35 UTC |
7be64f8 | Zhang Yunjun | 10 June 2019, 00:28:54 UTC | bugs fix (#86) * mkdocs: bug fixed for repo_url * installation: new fix for PROJ_LIB (by piyushrpt) | 10 June 2019, 00:28:54 UTC |
f207fdd | Zhang Yunjun | 08 June 2019, 00:09:02 UTC | initial https://mintpy.readthedocs.io + setup mintpy.readthedocs.io + add mkdocs.yml and readthedocs.yml + move the following files from root to docs - requirements.txt - CONTRIBUTING.md + move the following files from Wiki to docs - api/attributes.md - api/coord.md - api/doc_generation.md - api/Doxyfile - api/latex.sty - google_earth.md - hdfeos5.md + add the following files in docs - references.md + move the following files out of github repo - docs/resources/coord_index.png - docs/resources/FernandinaSenDT128_POI.jpg - docs/resources/KujuAlosAT422F650_vel.jpg - docs/resources/WellsEnvD2T399_CO_POI.jpg - docs/resources/web_viewer_screenshot.png | 09 June 2019, 17:15:09 UTC |
d21cb73 | Zhang Yunjun | 07 June 2019, 02:05:15 UTC | Update download button link on github pages | 09 June 2019, 17:15:09 UTC |
b17a01d | Zhang Yunjun | 08 June 2019, 16:36:47 UTC | Update conda.txt | 08 June 2019, 17:09:12 UTC |
37863c7 | Zhang Yunjun | 07 June 2019, 03:00:35 UTC | docs/paper: add markdown description (#82) * Update installation.md * Update installation.md * Update share.html * Update README.md * docs/paper: add markdown description | 07 June 2019, 03:00:35 UTC |
4eb3fe1 | Zhang Yunjun | 07 June 2019, 00:21:50 UTC | fixed link for license and sh scripts (#81) * Update README.md * Update README.md | 07 June 2019, 00:21:50 UTC |
b2757f0 | Zhang Yunjun | 07 June 2019, 00:03:45 UTC | link fixed for docs/README.md (#80) * Update README.md * Update README.md | 07 June 2019, 00:03:45 UTC |
d171ca2 | Zhang Yunjun | 06 June 2019, 23:40:29 UTC | GitHub Pages: move files to docs/ (#79) Move the files related with github pages from root to docs directory, for more simple structure. Add github user name (insarlab) to the page title. | 06 June 2019, 23:40:29 UTC |
3438022 | Zhang Yunjun | 06 June 2019, 22:58:02 UTC | smallbaselineApp: add mintpy.topographicResidual.pixelwiseGeometry option 1. add mintpy.topographicResidual.pixelwiseGeometry option to speedup the DEM error correction step [turned OFF by defalut] 2. add example in dem_error.py to generate updated/corrected DEM file 3. save_roipac: get rid of the starting "." in the dataset name if output file is HDF5 file. 4. add: ignore dataset name if input file is single dataset, to be able to support input files without different dataset names. | 06 June 2019, 22:59:44 UTC |
8595ce0 | Zhang Yunjun | 06 June 2019, 21:00:34 UTC | unwrap_error_bridging: use input bridgePtsRadius 1. use input custom bridge endpoint radius for phase difference calculate. 2. change default bridgePtsRadius value from 150 to 50 pixels 3. more comments on defaults/smallbaselineApp.cfg | 06 June 2019, 21:55:53 UTC |
269bc76 | Zhang Yunjun | 05 June 2019, 21:30:16 UTC | bugs fix for geo dataset without incidence angle file | 06 June 2019, 21:55:53 UTC |
968fb6e | Zhang Yunjun | 06 June 2019, 21:14:57 UTC | ut.check_loaded_dataset(): remove duplicated print for lookup file | 06 June 2019, 21:18:02 UTC |
baa4fe7 | hfattahi | 06 June 2019, 05:24:36 UTC | removing unused variables | 06 June 2019, 21:18:02 UTC |
a892aba | hfattahi | 06 June 2019, 04:46:41 UTC | adding more metadata | 06 June 2019, 21:18:02 UTC |
c263eac | hfattahi | 04 June 2019, 16:32:24 UTC | adding prep_aria.py and bug fix in utils.py for geoicoded dataset (checking look_up file will be skipped for geocoded data) | 06 June 2019, 21:18:02 UTC |
bb40ce4 | Zhang Yunjun | 06 June 2019, 21:14:57 UTC | ut.check_loaded_dataset(): remove duplicated print for lookup file | 06 June 2019, 21:14:57 UTC |
d025679 | hfattahi | 06 June 2019, 05:24:36 UTC | removing unused variables | 06 June 2019, 05:24:36 UTC |
37f2780 | hfattahi | 06 June 2019, 04:46:41 UTC | adding more metadata | 06 June 2019, 04:46:41 UTC |
370098f | Zhang Yunjun | 05 June 2019, 19:22:15 UTC | asc_desc2horz_vert: checking spatial resolution | 05 June 2019, 19:26:36 UTC |
3ce80a8 | Zhang Yunjun | 04 June 2019, 01:17:23 UTC | ifg_inv: do not call *ifgram_inversion_dask folder if no parallel update comments in template file for `mintpy.load.*File` options | 05 June 2019, 19:26:36 UTC |
466cb60 | hfattahi | 04 June 2019, 16:32:24 UTC | adding prep_aria.py and bug fix in utils.py for geoicoded dataset (checking look_up file will be skipped for geocoded data) | 04 June 2019, 16:32:24 UTC |
944a39a | Falk Amelung | 30 May 2019, 12:04:37 UTC | add dask walltime option (#72) + * mintpy/defaults/dask.yaml - rename dask_mintpy.yaml --> dask.yaml - add *.e file for job submission - remove unused `ifgram_inversion` section + add `mintpy.networkInversion.walltime` option for `smallbaselineApp.py` and `--parallel-walltime` option for `ifgram_inversion.py` + add `move_dask_stdout_stderr_files()` in `utils/utils.py` | 30 May 2019, 12:04:37 UTC |
bad2d22 | Zhang Yunjun | 25 May 2019, 03:50:32 UTC | update ./docs/paper 1. update filename and work directory for all notebook to be consistent with the latest version of paper. 2. add link of ./docs/paper to the README 3. mintpy/unwrap_error_phase_closure: add get_number_of_nonzero_closure_phase() | 25 May 2019, 05:45:31 UTC |
dcfe73e | Zhang Yunjun | 21 May 2019, 18:24:16 UTC | process_isce_stack: bug fix for optional masterDate | 25 May 2019, 05:45:31 UTC |
6064ed8 | Yunmeng Cao | 23 May 2019, 14:10:21 UTC | prep_gamma: add gamma command to generate *.off file if missing (#69) * check off_file and generate automatically if without; fix bugs for dem_par file name | 23 May 2019, 14:10:21 UTC |
9f154e0 | Zhang Yunjun | 20 May 2019, 17:05:27 UTC | objects/resample: reduced memory usage for AOI (#68) * docs/ports: update opencv variant * process_isce_stack: copy template file to project root dir * add sh/load_data_aoi.sh to load data for an AOI from the whole track of dataset within mintpy * objects/resample: reduced memory usage + use `pyresample.data_reduce` module to use only revalent part for interpolation when input SNWE is less than half of the source file in terms of area. + rename the following two functions: - get_geometry_definition4radar_lookup_table() --> prepare_geometry_definition_radar() - get_geometry_definition4geo_lookup_table() --> prepare_geometry_definition_geo() | 20 May 2019, 17:05:27 UTC |
21807c3 | Zhang Yunjun | 18 May 2019, 23:19:27 UTC | bug fix for utils/writefile | 19 May 2019, 15:13:50 UTC |
de046b0 | Zhang Yunjun | 19 May 2019, 15:07:16 UTC | smallbaselineApp: add ERA5 [experimental] (#66) * smallbaselineApp: add ERA5 option + add ERA5 option support in `smallbaselineApp.py`; ECMWF for ERAI is still the default. + This is experimental and should be used only by advanced users who have successfully installed pyaps3 from yunjunz account. Bugs and warnings are expected. + adjust `plot_smallbaselineApp.sh` to plot ERA5 corrected time-series too. + bug fixed for writefile * tropo_pyaps3: + dload ERA5 every 10 deg instead of 5 + show progressBar * process_isce_stack: add support for ALOS-2 + Copy job4stripmapStack.cfg to the working directory for easy modification to specific dataset + add prepare_ALOS2() + adjust prepare_stack() for ALOS2 with --nofocus + adjust run_stack() to use the local job2stripmapStack.cfg file + adjust main() to be more generic to varios sensors + use shelve files from SLC dir instead of Igrams + bug fixed for sensor/project_name2sensor_name() when there is confusion between alos2 and alos, fix by putting alos2 in front with higher priority. * bug fix * utils/writefile: use compression from ref_file + `utils/readfile`: add `get_hdf5_compression()` to grab the compression type of an input HDF5 file. + `utils/writefile`: use compression type from reference file if input compression is None; similar for `write2hdf5()` in `timeseries` class in `objects/stack.py`. + `view`: dipslay date12 in two lines to better readibility | 19 May 2019, 15:07:16 UTC |
93816d3 | Zhang Yunjun | 16 May 2019, 21:07:12 UTC | Simplify CONTRIBUTING.md for git workflow | 17 May 2019, 00:03:20 UTC |
6840302 | Zhang Yunjun | 16 May 2019, 20:35:16 UTC | utils/ptime: support list input for decimal_year2datetime() (#64) + utils/ptime: support list of float/str input for decimal_year2datetime() + objects/coord: return box of the whole area if input box is None + update links in README and version number in the LICENSE file. | 16 May 2019, 20:35:16 UTC |
239f7ff | Falk Amelung | 14 May 2019, 21:28:39 UTC | Update README.md | 14 May 2019, 21:28:39 UTC |
d557ea1 | Falk Amelung | 14 May 2019, 21:27:52 UTC | Update README.md | 14 May 2019, 21:27:52 UTC |
e60940b | Zhang Yunjun | 14 May 2019, 18:53:11 UTC | version: bug fix when no new commit after last release | 14 May 2019, 19:04:10 UTC |
5cbe914 | Zhang Yunjun | 14 May 2019, 17:54:29 UTC | docs: update (#62) * update label in figures of example datasets * update acronym and the version number in README.md | 14 May 2019, 17:54:29 UTC |
4c2b6f8 | Zhang Yunjun | 12 May 2019, 16:56:25 UTC | rename PySAR to MintPy (#61) $PYSAR_HOME --> $MINTPY_HOME #used in installation and documentations. PySAR --> MintPy #for names in comments and text mostly. pysar --> mintpy #for module import pysarApp.py --> smallbaselineApp.py sh/plot_pysarApp.sh --> sh/plot_smallbaselineApp.sh #shell script to plot results of sbasApp.py defaults/pysarApp.cfg --> smallbaselineApp_auto.cfg #files of specific option value for all "auto" in sbasApp.cfg pysar.load.unwFile --> mintpy.load.unwFile objects rename giantobj --> giant insarobj --> stackDict pysarobj --> stack update file/dir structure /PYSAR --> /mintpy /GEOCODE --> /geo #files after runing geocoding (for dataset in radar coordinates only as dataset in geo coordinates won't need to run geocode.py) /INPUTS --> /inputs #input files folder, so that one can move/copy this folder and re-generate everything afterwards. /PIC --> /pic #for figures, kmz files, etc. adjust all related documents, comments, notebooks | 12 May 2019, 16:56:25 UTC |
db9dfa5 | Zhang Yunjun | 09 May 2019, 02:59:04 UTC | update comments (#60) + docs/paper: update link for nbviewer + add temp-c custom colormap cpt file + add -s besides --start-date and -e besides --end-date for timeseries2velocity.py + asc_desc2horz_vert: add example to prepare asc/desc data | 09 May 2019, 02:59:04 UTC |
a9ec91b | Zhang Yunjun | 02 May 2019, 23:18:00 UTC | geocode: add OMP_NUM_THREADS control + add geocode/check_num_processor() to check OMP_NUM_THREADS if it's defined in environment variable and use it if --nprocs is not specified. + set default --nprocs to 1 because 1) bonding between pykdtree and openmp is not clear yet and 2) the speedup is negligible for macport install and slows down for conda install + change default nprocs value to 1 in objects/resample.py + detect lookup table file in current directory besides the INPUTS directory. | 03 May 2019, 00:25:36 UTC |
406c823 | Zhang Yunjun | 01 May 2019, 17:19:31 UTC | geocode: fix typo in help (#57) fix typo in geocode.py and objects/pysarobj.py | 01 May 2019, 17:19:31 UTC |
3caeaea | Zhang Yunjun | 30 April 2019, 20:55:53 UTC | pysarApp: more compatiable with py2-pyaps (#55) * Update README.md * pysarApp: more compatiable with py2-pyaps calling tropo_pyaps.py as an executable script using subprocess.Popen() to make pysarApp.py works with py2-pyaps from caltech. The current way of importing tropo_pyaps as an sub-module is preferred but it failed to import python2 sub-modules in python3 environment. | 30 April 2019, 20:55:53 UTC |
d62d1b3 | Bhuvan Varugu | 30 April 2019, 20:28:39 UTC | save_roipac.py: bug fix for data reading for single dataset files (#53) * added read data line for all file types of single datasets | 30 April 2019, 20:28:39 UTC |
bd67db3 | Zhang Yunjun | 30 April 2019, 17:30:16 UTC | test/test_pysarApp: add argument parsing + add argument parsing functions to be more user friendly. + add --dir to be able to change test directory + add --nofresh to be able to start processing not from the scratch, suitable for testing bugs in the middle of processing. | 30 April 2019, 20:09:42 UTC |
b3a4176 | Zhang Yunjun | 30 April 2019, 15:32:31 UTC | timeseries_rms: bug fix for plotting (#52) * bug fixed for timeseries_rms * Update prep_isce.py | 30 April 2019, 15:32:31 UTC |
b54877d | Zhang Yunjun | 29 April 2019, 15:27:40 UTC | bugs fix for unwrap error correction (#51) docs/examples/input_files/GalapagosSenDT128.template: add pysar.load.waterMaskFile generated by ISCE pysar.unwrapError.waterMaskFile: change default value to waterMask.h5 or no if waterMask.h5 is not found; to be the same as pysar.network.waterMaskFile and pysar.networkInversion.waterMaskFile dem_error: bug fixed for 3D bperp reading when it has different number of acquisitions from the time-series file get rid of string yunjunz from the code in objects/sensor.py and version.py unwrap_error_phase_closure: fix bugs when there are interferograms excluded in ifgramStack.h5 file utils/writefile: fix bug in remove_hdf5_dataset() when input fname is not just basename. version: move code into get_release_info() Update installation.md | 29 April 2019, 15:27:40 UTC |
18f11e4 | Zhang Yunjun | 27 April 2019, 02:03:25 UTC | version: auto grab code version and date + do not install pykml through conda channel, which will cause error; install py2/3-pykml from yunjunz through Anaconda's pip + remove openmp from requirements.txt as it's not directly used by pysar, it's used by pyresample implictly | 27 April 2019, 03:06:10 UTC |
eb222bb | Zhang Yunjun | 26 April 2019, 20:02:03 UTC | info: rename --nodrop to --show-ifgram info: + rename previous --nodrop option to --show / --show-ifgram option to avoid confusion + bug fixed for --num option when show kept interferograms only. + simplified code plot/select_network: rename --nodrop to --show-kept to avoid confusion. | 26 April 2019, 20:06:07 UTC |
29311e4 | Zhang Yunjun | 26 April 2019, 03:09:52 UTC | Update installation.md | 26 April 2019, 03:09:52 UTC |
11cfce4 | Zhang Yunjun | 26 April 2019, 03:06:28 UTC | Update installation.md | 26 April 2019, 03:06:28 UTC |
8a84005 | Lei | 26 April 2019, 00:50:17 UTC | pysarApp: expose more parameters for empirical tropospheric delay correction (#46) * expose `pysar.troposphericDelay.minCorrelation` option. * pass `pysar.troposphericDelay.looks` from `pysarApp.py` to `tropo_phase_elevation.py` | 26 April 2019, 00:50:17 UTC |
9cce2b9 | Zhang Yunjun | 25 April 2019, 21:38:42 UTC | docs/tutorials/pysarApp: update superlink | 25 April 2019, 21:40:15 UTC |
d067089 | Zhang Yunjun | 25 April 2019, 21:33:30 UTC | installation: more note on parallel setup | 25 April 2019, 21:33:30 UTC |
730c2e3 | Zhang Yunjun | 25 April 2019, 17:08:04 UTC | prep_gamma: add LAT/LON_REF1/2/3/4 info to geometry files + merge `extract_metadata4dem_geo()` and `extract_metadata4lookup_table` into `extract_metadata4geometry_geo()` + rename `extract_metadata4dem_radar()` to `extract_metadata4geometry_radar()` + searching for LAT/LON_REF1/2/3/4 info for geometry files in radar coordinates + move code inside prepare_metadata() into main() | 25 April 2019, 19:18:56 UTC |
f3eb60d | Zhang Yunjun | 24 April 2019, 02:26:02 UTC | docs/paper: add shell scripts | 25 April 2019, 02:14:03 UTC |
63a6ea8 | Zhang Yunjun | 24 April 2019, 02:00:34 UTC | add docs/paper Add `docs/paper` for the figures in Yunjun et al., 2019 | 24 April 2019, 02:14:39 UTC |
30b3ada | Zhang Yunjun | 24 April 2019, 01:47:15 UTC | docs/examples/input_files: add template files for the paper Update README.md | 24 April 2019, 02:14:39 UTC |
bb0f91f | Zhang Yunjun | 24 April 2019, 00:39:55 UTC | move examples to docs/examples | 24 April 2019, 02:14:39 UTC |
666612b | Zhang Yunjun | 24 April 2019, 00:36:30 UTC | docs: rename Notebooks to tutorials | 24 April 2019, 02:14:39 UTC |
1a7ad41 | Zhang Yunjun | 23 April 2019, 15:52:58 UTC | tropo_pyaps3: bug fix | 24 April 2019, 02:14:39 UTC |
8990a58 | Zhang Yunjun | 22 April 2019, 21:45:22 UTC | utils/ptime: add datenum2datetime + utils/ptime: add datenum2datetime() to convert Matlab datenum into Python datetime format + timeseries_rms: update matplotlib.pyplot.bar usage in plot_rms_bar(). | 24 April 2019, 02:14:39 UTC |
1a48e97 | Zhang Yunjun | 19 April 2019, 22:15:55 UTC | save_roipac: support HDF_EOS5 file + objects/pysarobj: add HDFEOS.get_date_list() + utils/readfile: remove the following obsolete global variables for py2 psyar: - multi_group_hdf5_file - multi_dataset_hdf5_file - single_dataset_hdf5_file + save_roipac: - remove --ref-date option because it's not convenient to use - support date1_date2 input for timeseries and HDFEOS files to change reference date easily. - support HDF-EOS5 file, including the displacement, temporalCoherence and all geometry datasets. | 19 April 2019, 22:23:24 UTC |
fd15fd2 | Zhang Yunjun | 19 April 2019, 05:21:32 UTC | update docs for pyaps3 + update requirements for pyaps3 + update installation for pyaps3 and dask setup + simplify README.md | 19 April 2019, 22:22:02 UTC |
e53f3a3 | Zhang Yunjun | 19 April 2019, 02:45:45 UTC | ifgram_inversion: add NUM_WORKERS back for dask | 19 April 2019, 04:24:33 UTC |
24c41a2 | Zhang Yunjun | 19 April 2019, 02:20:59 UTC | add tropo_pyaps3.py for pyaps3 with ERA5 print message adjustment in view.py and objects/pysarobj.py add tropo_pyaps3.py in response to pyaps3 from Angelique Benoit on Github, compared with tropo_pyaps.py, there are several changes: 1. add support for ERA-5 dataset with hourly temporal resolution and ~32 km spatial resoluion. 2. use ERA5, ERAINT etc as weatherModel name instead of ECMWF, which is essential an organization name. 3. do not generate and remove ROIPAC style geometry files with rsc file anymore as the input of PYAPS is 2D array directly. 4. ERA5 support area subset download, instead of previously ERAI downloads the data for the entire world, saves a lot of space. 5. do not set minimum file size anymore as area subset file is very small. 6. merge radar/geo coordinates PyAPS objects into one, as the input of lat/lon does not distinguish radar or geo | 19 April 2019, 04:24:33 UTC |
07ebc84 | Zhang Yunjun | 18 April 2019, 22:58:10 UTC | add parallel option to template file 1. add the following two option into pysarApp_template.txt for parallel processing: + pysar.networkInversion.parallel with auto for no + pysar.networkInversion.numWorker with auto for 40 ifgram_inversion: + catch and print import error for dask modules + change minRedundancy variable type from float to int + support reading parallel options from input template file + remove obsolete option `skip_zero_phase` + rename the following two functions: - split_into_boxes() --> split2boxes() - subsplit_boxes_by_num_workers() --> subsplit_boxes4workers() + use inps.numWorker directly without NUM_WORKERS + rename variable number_of_splits to num_split | 19 April 2019, 04:24:33 UTC |
4ce81aa | Zhang Yunjun | 18 April 2019, 04:14:47 UTC | Revert "ifgram_inversion: import dask module for --parallel option only" This reverts commit d1499c7f17f7f63055554aa9c940641e6d007f13. | 19 April 2019, 04:24:33 UTC |
2fcff4e | Zhang Yunjun | 14 April 2019, 17:03:31 UTC | ifgram_inversion: import dask module for --parallel option only | 19 April 2019, 04:24:33 UTC |
fcf5758 | Falk Amelung | 19 April 2019, 01:05:30 UTC | remove temporarily `import dask` (#40) | 19 April 2019, 01:05:30 UTC |
b043522 | Zhang Yunjun | 18 April 2019, 04:07:43 UTC | utils/readfile: bug fix while reading ISCE file with full in filename (#39) utils/readfile: + exclude `.full` while checking FILE_TYPE for ISCE binary files + more generic read_binary() by do not distinguish num_band utils/writefile: update comments | 18 April 2019, 04:07:43 UTC |
ba88a24 | Zhang Yunjun | 16 April 2019, 21:23:33 UTC | process_isce_stack: copy masterShelve to the root directory (#38) * process_isce_stack: add copy_masterShelve() * process_isce_stack: add --submit as an alternative to --bsub * utils/plot: use "1 km" instead of "1000 m" for scale bar * utils/plot: adjust parameter for DEM shaded relief min/max | 16 April 2019, 21:23:33 UTC |
4abe4c3 | David W Grossman | 15 April 2019, 20:02:11 UTC | updated minimum dask_jobqueue version (#37) * updated minimum dask_jobqueue version | 15 April 2019, 20:02:11 UTC |
d3cac2b | Zhang Yunjun | 14 April 2019, 16:56:55 UTC | bug fix for tsview when reference point is outside of the display subset (#34) | 14 April 2019, 16:56:55 UTC |
c2cdc11 | David W Grossman | 13 April 2019, 17:39:38 UTC | Lowered Dask memory config | 13 April 2019, 17:39:38 UTC |
5e3beda | Zhang Yunjun | 11 April 2019, 23:57:56 UTC | utils/utils: add win_size in read_timeseries_lalo/yx (#33) | 11 April 2019, 23:57:56 UTC |
ad15a88 | David W Grossman | 10 April 2019, 15:18:16 UTC | Added Dask config defaults & fixed #31 (#32) * Updated Dask config and refactored Dask comments * Fix for #31 and fix cluster.close() throwing an exception * Added examples, added NUM_WORKERS to params, cleaned up subsplit() func * add par parser group for num_workers | 10 April 2019, 15:18:16 UTC |
dc776ac | David W Grossman | 09 April 2019, 21:50:08 UTC | Included dask-jobqueue in the imports (#29) dask-jobqueue is the library used to run Dask on HPC. | 09 April 2019, 21:50:08 UTC |
15e6441 | Zhang Yunjun | 09 April 2019, 19:43:23 UTC | ifgram_inversion: bug fixed while runing in command line (#30) | 09 April 2019, 19:43:23 UTC |
ed5c794 | Zhang Yunjun | 08 April 2019, 23:57:34 UTC | save_roipac: drop all lower case keys for geodmod (#28) + save_roipac: drop all attributes with key name not all upper case, to better support geodmod + utils/readfile: add default value for num_band and band_interleave | 08 April 2019, 23:57:34 UTC |
d49789f | Zhang Yunjun | 08 April 2019, 22:08:33 UTC | examples: add notebook for GACOS (#27) * dem_gsi: add reference datum info + add reference datum info into xml file so that ISCE will not convert it again, as DEHM from GSi is already in ellipsoid. The indent needs to be adjusted, this should not be a problem for now. + change default output name to be consistent with ISCE convention: gsi10m.dem --> gsi10m.dem.wgs84 * ports: remove sundials and petsc due to gcc5 and 8 conflict * examples: add notebook for GACOS add example notebook to correct tropospheric delay using GACOS product for geocoded time-series file. | 08 April 2019, 22:08:33 UTC |