https://github.com/carla-simulator/carla
Raw File
Tip revision: b11bfcfdb196ea51900734ddc8e94302a23b7b68 authored by germanros1987 on 16 December 2018, 07:28:20 UTC
Update how_to_make_a_new_map.md
Tip revision: b11bfcf
benchmark_basic_results_town01.md
We show the results for test and train weathers when
[running the simple example](benchmark_creating/#expected-results) for Town01.
The following result should print on the screen after running the
example.

    ----- Printing results for training weathers (Seen in Training) -----


    Percentage of Successful Episodes

      Weather:  Clear Noon
        Task: 0  ->  1.0
        Task: 1  ->  0.0
        Task: 2  ->  0.0
        Task: 3  ->  0.0
      Average Between Weathers
        Task  0  ->  1.0
        Task  1  ->  0.0
        Task  2  ->  0.0
        Task  3  ->  0.0

    Average Percentage of Distance to Goal Travelled

      Weather:  Clear Noon
        Task: 0  ->  0.9643630125892909
        Task: 1  ->  0.6794216252808839
        Task: 2  ->  0.6593855166486696
        Task: 3  ->  0.6646695325122313
      Average Between Weathers
        Task  0  ->  0.9643630125892909
        Task  1  ->  0.6794216252808839
        Task  2  ->  0.6593855166486696
        Task  3  ->  0.6646695325122313

    Avg. Kilometers driven before a collision to a PEDESTRIAN
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  -> more than 0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  -> more than  0.22983408429063365

    Avg. Kilometers driven before a collision to a VEHICLE
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  ->  0.11491704214531683
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  ->  0.11491704214531683

    Avg. Kilometers driven before a collision to a STATIC OBSTACLE
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  ->  0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  ->  0.22983408429063365

    Avg. Kilometers driven before going OUTSIDE OF THE ROAD
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  ->  0.12350085985904342
        Task  2  ->  0.2400373917146113
        Task  3  -> more than 0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  ->  0.12350085985904342
        Task  2  ->  0.2400373917146113
        Task  3  -> more than  0.22983408429063365

    Avg. Kilometers driven before invading the OPPOSITE LANE
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  -> more than 0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  -> more than  0.22983408429063365





    ----- Printing results for test weathers (Unseen in Training) -----


    Percentage of Successful Episodes

      Weather:  Clear Noon
        Task: 0  ->  1.0
        Task: 1  ->  0.0
        Task: 2  ->  0.0
        Task: 3  ->  0.0
      Average Between Weathers
        Task  0  ->  1.0
        Task  1  ->  0.0
        Task  2  ->  0.0
        Task  3  ->  0.0

    Average Percentage of Distance to Goal Travelled

      Weather:  Clear Noon
        Task: 0  ->  0.9643630125892909
        Task: 1  ->  0.6794216252808839
        Task: 2  ->  0.6593855166486696
        Task: 3  ->  0.6646695325122313
      Average Between Weathers
        Task  0  ->  0.9643630125892909
        Task  1  ->  0.6794216252808839
        Task  2  ->  0.6593855166486696
        Task  3  ->  0.6646695325122313

    Avg. Kilometers driven before a collision to a PEDESTRIAN
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  -> more than 0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  -> more than  0.22983408429063365

    Avg. Kilometers driven before a collision to a VEHICLE
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  ->  0.11491704214531683
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  ->  0.11491704214531683

    Avg. Kilometers driven before a collision to a STATIC OBSTACLE
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  ->  0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  ->  0.22983408429063365

    Avg. Kilometers driven before going OUTSIDE OF THE ROAD
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  ->  0.12350085985904342
        Task  2  ->  0.2400373917146113
        Task  3  -> more than 0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  ->  0.12350085985904342
        Task  2  ->  0.2400373917146113
        Task  3  -> more than  0.22983408429063365

    Avg. Kilometers driven before invading the OPPOSITE LANE
      Weather:  Clear Noon
        Task  0  -> more than 0.04316352371637994
        Task  1  -> more than 0.12350085985904342
        Task  2  -> more than 0.2400373917146113
        Task  3  -> more than 0.22983408429063365
      Average Between Weathers
        Task  0  -> more than  0.04316352371637994
        Task  1  -> more than  0.12350085985904342
        Task  2  -> more than  0.2400373917146113
        Task  3  -> more than  0.22983408429063365



back to top