| 11332fa | holger-nutonomy | 30 April 2019, 04:00:02 UTC | Loosen PIP requirements (#136) * Make requirements less strict * Added clarification on file name, minor corrections | 30 April 2019, 04:00:02 UTC |
| 21771d6 | holger-nutonomy | 12 April 2019, 02:04:05 UTC | Detection eval results format and readme (#115) * Added meta data to submission and rewording * Overhauled readme and comments * Make it explicit that 0.5s time window is only relevant at test time * Modified eval code for new result format * Renamed weighted_sum to nd_score * Clarification on maximum time window * Added option to use test set with annotations for eval server * Also writing meta data to output file * Write only a subset of examples to disk, create example folder * Make sure test GT is not visualized and plot 10 examples by default. * Print metrics to stdout * Standardize number format * Write more user-friendly metric names to stdout * Refactoring: Moved writing to disk/stdout one level up, renamed run() to evaluate(), made main a class method * Option to not render curves * Fixed return type and docstring * Save mean_dist_aps to directly show them in the leaderboard | 12 April 2019, 02:04:05 UTC |
| 9e4ecbb | sergi-nutonomy | 10 April 2019, 05:23:08 UTC | Export 2d annotations (#97) * Initial commit * Removed cv2.rectangle * Use nuscenes methods, removed return * Venice's comments * Missing return docstring * Handles the instances where the box extends outside image * Addressed Oscar's comments * path, doscstring mistakes * ANY * filename * Some changes: 1. Retrieve the corners of the 3D bounding box that is in front of the camera. 2. Used the convex hull of the corners. 3. Retrieve the intersecting polygons. 4. Bounding box corners is decided from the intersecting polygons * Docstrings * Cleanup * nargs * Added shapely to the requirements | 10 April 2019, 05:23:08 UTC |
| 0611271 | chris-li-nutonomy | 08 April 2019, 20:06:54 UTC | * Added xvfb to list of packages to install. (#103) * Re-organized Jenkins pipeline such that build and test occurs in separate stages. * Added logic to test notebooks during Jenkins pipeline. * Deleted old bash scripts for testing. | 08 April 2019, 20:06:54 UTC |
| 3e1f93e | sourabh-nutonomy | 08 April 2019, 18:27:19 UTC | Update NuScenesExplorer (#99) * added out_path args to all render methods * assert video extensions are .avi. bugfix in cv2.VideoWriter | 08 April 2019, 18:27:19 UTC |
| d969a17 | Donghyeon Won | 02 April 2019, 18:27:21 UTC | EvalBoxes bug quick fix (#106) | 02 April 2019, 18:27:21 UTC |
| 99a8e5f | Qiang Xu | 27 March 2019, 18:29:54 UTC | Remove empty lines in README. (#102) | 27 March 2019, 18:29:54 UTC |
| a70f29c | Alex Lang | 27 March 2019, 16:43:02 UTC | Add paper references (#101) * Added paper references to readme | 27 March 2019, 16:43:02 UTC |
| fec7e13 | Oscar Beijbom | 26 March 2019, 23:08:11 UTC | updated readme (#98) | 26 March 2019, 23:08:11 UTC |
| ef32617 | sourabh-nutonomy | 26 March 2019, 23:06:41 UTC | removed legacy map binarize (#100) | 26 March 2019, 23:06:41 UTC |
| 4561d30 | Oscar Beijbom | 26 March 2019, 14:57:20 UTC | updated URL to WAD | 26 March 2019, 14:57:20 UTC |
| e9f08cb | Alex Lang | 26 March 2019, 05:22:43 UTC | preparation for pip package v1.0.0 (#96) | 26 March 2019, 05:22:43 UTC |
| 0334132 | Oscar Beijbom | 25 March 2019, 23:07:51 UTC | Release v1.0.0 (#64) * Added setup.py for pip installation * Added speedup to query many points with single function call in map mask * Added missing methods for improved map mask * Changes for v0.2 * Updated tutorial path * Changed logic s.t. map table points to logs, not 1 to 1 * Fix indexing bug * Reset paths to default * Removed print statement from setup.py * Fixed a bug for large map files * Not excluding any logs from map rendering * Fixed bug with missing "self" keyword in create_splits_logs(nusc), added dataroot parameter * Address bug for classes without attributes * Fixed misspelled motorcycle * Added missing keyword self * Added checks for nan values * Removed teaser splits as they is not compatible with the new logs * Added (preliminary) splits for v0.2 * Workaround to allow evaluating a subset of the data * Splits hardcoded in create_splits_logs * Fix bugs if a results file has zero TPs * Simpler MapMask (#31) * deleted distance_mask, binary_mask. Created dilate_mask(). * cleanup docstring * Added missing Dict import (#35) * Typing fix (#36) * Added missing Dict import * Fixed typing to be compatible where future annotations package cannot be loaded * Updated code to new folder structure (#37) * Devkit now accepts versions 0.3, 0.4 and 1.0 * Fix TPs analog to commit 94544b5202389c48d3c3f9eea321a368c5725bc4 (#41) * Fix yaw_diff calculation (#46) * Added unittest to catch previous error in yaw_diff * Updated dataset to v0.4, updated train/val/test splits * Added assertion * Cleaned up map API. * Evaluation Fixes (#51) * Correct recall edge case * Apply distance filtering to xy only * Return max error if recall is too low * Added dataset version as command line argument to nuscenes_eval.py * Function to get scenes in each split, script to check dataset completeness * Added command line arguments to launch scripts * Hotfix for call to create_splits_logs * Structure re-org towards more tests. (#52) - Moves files around to enable easier inject of tests. - Enables running unit-tests per usual python -m unittest - Requires env. variable $NUSCENES for test. - Added trivial unit-tests for NuScenes & NuScenesEval. Currently uses v0.2. We should switch to mini when data is ready. - Moved detection eval code to eval/detection to future-proof for next task. This PR is only the first step. The next PR will break out the detection eval code to enable testing. * Updated dataset splits to v1.0 * Updated version to 1.0 and database folder to /data/sets/nuscenes * Added explanation that visibility token may be empty * Style update (#59) * Changed format of data_classes.py and avoided default parameters in RadarPointCloud * Typing and line breaks in long method signatures * Reset dynprop_states to previous settings * Spacing and line breaks * Spacing * Break circular import dependencies * More flexible setup.py * Cleanup setup.py * Updated radar comments * fix setup to include root folder * Backporting bugfix from 873b30b6dc1af04d560919a06708796df80e1d53 until eval pr is merged * new pip package * Workaround to allow version string to include the split, e.g. v1.0-trainval * Mini splits and modified split logic (#63) * Added mini splits and updated overall logic, note: changed method signatures * Added an assertion * Docstrings * Fixed typo * Updated eval code to new splits function * Eval refactor step2 (#53) * reorganized repo to more allow for easier injection of tests. Moved detection eval code to eval/detection subfolder * Added verify and test instructions to main README * Added more thorough regression type test. This seem to have triggered an error in the evaluation code * Standardized dataroot to /data/sets/nuscenes * Fixed random seed. Passes unit-tests now * Added data-classes for the EvalBoxes. Cleaned up loading. Same results verified on test_delta() * Updated all tests to use the EvalBox data class. All tests passing now. * Changes to calculating distance from ego_vehicle (#57) * Changed result format to accept at most one attribute (#60) * Replaced attribute_scores by a single attribute_name * v0.2 CI preparation. (#65) * updated to 1.0-mini split for all tests. Skipped those that require DB * Misc Reorg (#68) * reorganize geometry code * add shortcuts to common classes * move quaternion yaw back * change default nuscenes to mini * Integrate mini_split into continuous integration (#71) * Enabled v1.0-mini to be used in CI for unit-tests. * Updated detection metrics code (#66) * Reorganized eval code to more allow for easier injection of tests. * Make nuScenes compatible to Python3.5/Python3.6 (#70) * Removed python 3.6 and 3.7 only features to make compatible with 3.5 * nuscenes-devkit pip package v0.3.4 * Added num_lidar_points and num_radar_points to schema * Added instructions to include lidar and radar points * update create_splits_logs to new database versions (#74) * Some unittests for algo.py and util.py (#76) * Added unittest for utils.py and algo.py * Repeat unit tests for Python 3.6, 3.7 + bug fix for false negative (#77) * Fixed false negative issue. Added support for 3.6 and 3.7. * Create a configuration factory (#78) * create a configuration factory * add unittests * fix the unittests * added token field to Box class (#79) * added token field to Box class * fixed line-break * Update README installation instructions. (#75) * Cleaned up README. Changed to support for python 3.6 and 3.7. * added change log message for release * * Moved continuous integration and Docker dependencies to 'setup' folder. (#80) * Updated readme files (#81) * Added setup/instrucions.md, updated Debris class definition, tuned main README * update setup.py to new repo structure * Update tutorial.ipynb * Simple Unittests for AP calculation (#82) * Clean up old unit tests and added tests for AP calculation * Revert setup changes to get CI working (#84) * Revert "* Moved continuous integration and Docker dependencies to 'setup' folder. (#80)" This reverts commit fa55433c35c6215aef0cc7813f479d4f61d30ce7. * revert setup.py changes * Bikerack filtering (#83) * spellcheck * add points_in_box() method to check whether points are inside the box * test points_in_box() method * perform bike rack filtering * docstring for filter_eval_boxes * added unittests for filter_eval_boxes() * update comment * fix docstring * can't use Box type because of a circular import. So switched to 'Box' * can't use Box type because of a circular import. So switched to 'Box' * change threshold after bikerack filtering * get max_dist from eval_detection_configs * Update eval renderers (#85) * Updated renderers for detection results. * Fixed bugs in detection evaluation. * Added color options for render_egoposes_on_map (#86) * add color option for render maps * Summary AP plot update (#87) * updated the plots * better legend text alignment * updated legend positions and pretty names for attributes and TP metrics * Tex table (#91) * added reder tex table * cleaned up tex render method * minor changes * add credits * misc cleanup * Instruction updates and misc (#89) * Set default version for export egoposes, better outputs * Added v1.0 to legal datasets * Corrected visibility level * Set face color to black, better status messages * Updated face color * Set set to trainval in misc scripts * Bugfix to preserver black bg color * Made close_dist a parameter * Merged truck classes in the instructions * Removed train from instructions * Merged police officers into single class * Reset changes to tutorial * Updated path to requirements.txt * Removed v1.0 which was used for setup purposes * Cleanup * Fix visibility levels in instructions * Also print empty categories * Fixed bug * Reversed previous changes * Updated schema comments for map * Reverted previous changes * misc cleanup * next pip package * added unittests for TP metrics * Readme update (#93) * OVerhauled eval detection page * Overhauled main readme * Removed deprecated links * Rewording * Addressed review comments * fixed the visualize sample, need to test it * added comments to unit tests * [WIP] Jupyter notebook tutorial (#90) * Updated tutorial * Unittests for true positive error metrics calculation (#92) * added unittests for TP metrics * fixed visualize sample * added comments to unit tests * added option to save sample rendering to disk * added back showing plot if savepath is not given * Update README.md Clarifications * Update schema.md added an example for subcategories * update dates * cleanup imports, fix readme typos, cleaner scripts * cleanup evaluate * fix splits * update unittest to split logic * update test delta | 25 March 2019, 23:07:51 UTC |
| afabcfd | holger-nutonomy | 09 March 2019, 03:31:56 UTC | Added disclaimer (#58) * Added disclaimer * Added actual warning in the code | 09 March 2019, 03:31:56 UTC |
| 80c084e | chris-li-nutonomy | 09 March 2019, 01:46:49 UTC | Continuous integration (#54) * Added Jenkinsfile to version control. * Posts updates to Slack channel #nuscenes-ci * * Added Dockerfile to version control. * Updated command for running unittest inside of Docker container in Jenkins pipeline. * * Removed AWS env variables. | 09 March 2019, 01:46:49 UTC |
| 815f8b9 | holger-nutonomy | 22 February 2019, 23:06:22 UTC | Added unittest to catch previous error in yaw_diff | 22 February 2019, 23:06:22 UTC |
| ee4eafc | Eskil Jörgensen | 22 February 2019, 23:05:34 UTC | Fix yaw_diff calculation (#46) | 22 February 2019, 23:05:34 UTC |
| 82fcb4c | Eskil Jörgensen | 22 February 2019, 18:26:49 UTC | Fix incorrect reference to member output_dir (#45) Doing the same here, so that run_eval() works even when not called as __main__. | 22 February 2019, 18:26:49 UTC |
| 5486c38 | Eskil Jörgensen | 21 February 2019, 17:22:52 UTC | Fix incorrect reference to member nusc (#44) See https://github.com/nutonomy/nuscenes-devkit/issues/43 | 21 February 2019, 17:22:52 UTC |
| f529e4f | holger-nutonomy | 21 February 2019, 02:03:23 UTC | Same attr changes as in 94657906623d9b67bd66f8fe3ed1efa81eb104f0 (#42) | 21 February 2019, 02:03:24 UTC |
| 9e53e7d | holger-nutonomy | 21 February 2019, 01:55:20 UTC | Fix TPs analog to commit 94544b5202389c48d3c3f9eea321a368c5725bc4 (#41) | 21 February 2019, 01:55:20 UTC |
| 4e7d179 | holger-nutonomy | 19 February 2019, 20:25:17 UTC | Updated code to new folder structure (#37) | 19 February 2019, 20:25:17 UTC |
| e6c947f | holger-nutonomy | 19 February 2019, 20:22:50 UTC | Typing fix (#36) * Added missing Dict import * Fixed typing to be compatible where future annotations package cannot be loaded | 19 February 2019, 20:22:50 UTC |
| 5784dc7 | holger-nutonomy | 19 February 2019, 19:01:26 UTC | Added missing Dict import (#35) | 19 February 2019, 19:01:26 UTC |
| da8ccfd | holger-nutonomy | 28 January 2019, 05:04:53 UTC | Map mask speedup (#28) * Added setup.py for pip installation * Added speedup to query many points with single function call in map mask * Added missing methods for improved map mask | 28 January 2019, 05:04:53 UTC |
| 8d7392f | holger-nutonomy | 25 January 2019, 07:19:54 UTC | setup.py for PIP packages (#27) * Added setup.py for pip installation * Updated version | 25 January 2019, 07:19:54 UTC |
| 58b9daa | holger-nutonomy | 17 January 2019, 06:44:12 UTC | nuScenes detection evaluation code (#25) * Fixed typing issues * Added note that the schema is replicated on the homepage * Added box_velocity method * Added nuScenes detection evaluation code * Restructured folders * Updated imports, added header to each file * Updated readme and tutorial | 17 January 2019, 06:44:12 UTC |
| f9bb467 | holger-nutonomy | 05 December 2018, 01:33:36 UTC | Radar visualization (#16) * Added filtering for invalid RADAR points * Created separate classes for Radar and Lidar PointCloud * Fixed issue #15 * Fixed rare bug when point cloud is empty * Made readme clearer * Added radar visualization * Uncommented opencv rendering in tutorial * Added missign requirement for scipy * Implemented multisweep visualization * Reformatting * Added radar examples to tutorial * Advanced filtering options for radar points * Made nsweeps optional, refactoring * Updated notebook * Removed outputs from Ipython notebook * changed order of data class methods for readability * changed to used the same sample for full tutorial | 05 December 2018, 01:33:36 UTC |
| 56487d3 | Oscar Beijbom | 07 November 2018, 13:03:57 UTC | Merge pull request #11 from nutonomy/dev Visualization scripts and minor refactoring | 07 November 2018, 13:03:57 UTC |
| 8278b84 | Oscar Beijbom | 07 November 2018, 13:01:41 UTC | removed unused serialization code and updated plt.set_axis function calls | 07 November 2018, 13:01:41 UTC |
| e9e3276 | Oscar Beijbom | 07 November 2018, 12:46:26 UTC | cleanup of imports and Typing | 07 November 2018, 12:46:26 UTC |
| e663379 | Holger Caesar | 07 November 2018, 03:45:06 UTC | Fixed potential bug in export_pointclouds_as_obj.py | 07 November 2018, 03:45:06 UTC |
| 3fac8aa | Holger Caesar | 05 November 2018, 09:29:31 UTC | Standardized use of typing module | 05 November 2018, 09:29:31 UTC |
| 872e855 | Holger Caesar | 25 October 2018, 12:24:52 UTC | Refined database schema | 25 October 2018, 12:24:52 UTC |
| 2ab5aa0 | Holger Caesar | 25 October 2018, 09:32:34 UTC | Workaround to fix egopose visualization bug | 25 October 2018, 09:32:34 UTC |
| 85db2a1 | Holger Caesar | 25 October 2018, 06:22:18 UTC | Standardized visualization folder across scripts | 25 October 2018, 06:22:18 UTC |
| 20ecf69 | Holger Caesar | 25 October 2018, 06:15:24 UTC | Added scripts to export scene videos and ego poses | 25 October 2018, 06:15:24 UTC |
| 61bb363 | Holger Caesar | 25 October 2018, 06:15:05 UTC | Removed unused camera distortion parameters | 25 October 2018, 06:15:05 UTC |
| b1a68c5 | Holger Caesar | 25 October 2018, 05:51:50 UTC | Added a note on quaternions. | 25 October 2018, 05:51:50 UTC |
| 807ac24 | Holger Caesar | 25 October 2018, 05:49:13 UTC | Updated FAQs | 25 October 2018, 05:49:13 UTC |
| 1975945 | Holger Caesar | 25 October 2018, 05:33:08 UTC | Updated BoxVisibility and box_in_image to always filter if corners are in front of the camera, Replaced render_scene_on_map with more general render_egoposes_on_map, Added requirement for sklearn | 25 October 2018, 05:33:08 UTC |
| 07facb4 | Holger Caesar | 15 October 2018, 02:35:15 UTC | Added a script to render all scenes on the map | 15 October 2018, 02:35:15 UTC |
| e8e7225 | Holger Caesar | 12 October 2018, 07:42:32 UTC | Fixed table of contents | 12 October 2018, 07:42:32 UTC |
| 5182d63 | Holger Caesar | 12 October 2018, 07:42:08 UTC | Merge remote-tracking branch 'origin/master' into dev | 12 October 2018, 07:42:08 UTC |
| 6f62e7b | Oscar Beijbom | 11 October 2018, 14:57:27 UTC | Merge pull request #7 from nutonomy/readme-update Added changelog and FAQs to readme | 11 October 2018, 14:57:27 UTC |
| 5ffde10 | holger-nutonomy | 04 October 2018, 05:22:10 UTC | Added changelog and FAQs to readme | 04 October 2018, 05:22:10 UTC |
| 8f25895 | holger-nutonomy | 04 October 2018, 01:48:56 UTC | Radar file parser and point cloud export script (#6) * map_pointcloud_to_image now supports lidar and radar * Implemented radar pointcloud parser * Added script to export fused pointclouds for an entire scene | 04 October 2018, 01:48:56 UTC |
| 73b58e7 | Oscar Beijbom | 03 October 2018, 21:58:06 UTC | formatting | 03 October 2018, 21:58:06 UTC |
| b2d15b5 | Oscar Beijbom | 03 October 2018, 21:33:44 UTC | added tqdm progress bar | 03 October 2018, 21:33:44 UTC |
| 1fd297c | Holger Caesar | 03 October 2018, 08:36:17 UTC | Modified script to export a single scene, added progress messages, argparse | 03 October 2018, 08:36:17 UTC |
| 27580d6 | Holger Caesar | 28 September 2018, 09:19:39 UTC | Added script to export fused pointclouds | 28 September 2018, 09:19:39 UTC |
| 9cea12f | Holger Caesar | 28 September 2018, 08:06:41 UTC | Added typing | 28 September 2018, 08:06:41 UTC |
| 301af31 | Holger Caesar | 28 September 2018, 08:04:59 UTC | Implemented radar pointcloud parser | 28 September 2018, 08:04:59 UTC |
| 7b748cc | Holger Caesar | 28 September 2018, 06:47:23 UTC | map_pointcloud_to_image now supports with lidar and radar | 28 September 2018, 06:47:23 UTC |
| 78e5ad2 | Holger Caesar | 18 September 2018, 08:01:10 UTC | Refined virtual environment instructions | 18 September 2018, 08:01:10 UTC |
| e571e45 | Holger Caesar | 17 September 2018, 07:40:51 UTC | Added example image to readme | 17 September 2018, 07:40:51 UTC |
| 2228970 | holger-nutonomy | 17 September 2018, 07:35:01 UTC | Renamed utils folder to avoid errors (#5) | 17 September 2018, 07:35:01 UTC |
| fb69e12 | Holger Caesar | 17 September 2018, 05:32:29 UTC | Added database schema | 17 September 2018, 05:32:29 UTC |
| 983e088 | holger-nutonomy | 14 September 2018, 07:00:53 UTC | Links now pointing to www.nuscenes.org (#4) | 14 September 2018, 07:00:53 UTC |
| f7f057c | sourabh-nutonomy | 14 September 2018, 04:25:14 UTC | Misc cleanups (#2) * renamed folders, updated README and requirements. * typo * another typo * Deleted notebook checkpoint * added types and missing params for nuscenes explorer methods * updated import according to the renamed utils folder | 14 September 2018, 04:25:14 UTC |
| dc943fa | holger-nutonomy | 14 September 2018, 03:48:38 UTC | Merge pull request #1 from Alex-nutonomy/patch-1 Remove PCD Support | 14 September 2018, 03:48:38 UTC |
| 330ca94 | Holger Caesar | 14 September 2018, 03:47:18 UTC | Added instructions and cleaned up code | 14 September 2018, 03:47:18 UTC |
| d2ae72f | Alex Lang | 13 September 2018, 16:37:23 UTC | Merge pull request #1 from Alex-nutonomy/patch-2 Remove unneeded file support | 13 September 2018, 16:37:23 UTC |
| d4c7efb | Alex Lang | 13 September 2018, 16:35:02 UTC | remove pcd util | 13 September 2018, 16:35:02 UTC |
| ef313c5 | Alex Lang | 13 September 2018, 16:33:28 UTC | remove pcd support, clearer docstring | 13 September 2018, 16:33:28 UTC |
| aa1f4b1 | Holger Caesar | 12 September 2018, 13:53:03 UTC | Initial commit | 12 September 2018, 13:53:03 UTC |
