Skip to main content

Browse the archive

https://github.com/facebookresearch/pythia
31 March 2023, 09:22:40 UTC
sort by:
Revision Author Date Message Commit Date
b5b01bc omkar 10 July 2020, 03:47:33 UTC Multi-Task Training with Stop on Plateu 10 July 2020, 03:47:33 UTC
aea8edd omkar 07 July 2020, 01:37:49 UTC Multitask Training 07 July 2020, 01:37:49 UTC
2de4cdf omkar 06 July 2020, 06:30:31 UTC PlateuStop Initial Implementation 06 July 2020, 06:30:31 UTC
e5e15d4 omkar 05 July 2020, 19:52:56 UTC working visual 7w 05 July 2020, 19:52:56 UTC
8547412 omkar 03 July 2020, 01:00:54 UTC Removing debug code 03 July 2020, 01:00:54 UTC
5e9bc3c omkar 02 July 2020, 23:51:24 UTC MultiTask Training Initial Commit 02 July 2020, 23:51:24 UTC
eee2f3a omkar 01 July 2020, 22:09:55 UTC Merge branch 'vilbert_multitask_flickr30k' into multitask_training 01 July 2020, 22:09:55 UTC
95c6287 Vedanuj Goswami 01 July 2020, 18:14:51 UTC [fix] Fix should_log in training_loop (#379) Summary: Fixes https://github.com/facebookresearch/mmf/issues/378 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/379 Reviewed By: apsdehal Differential Revision: D22334049 Pulled By: vedanuj fbshipit-source-id: faa51b4c8cf865850851df334b9971de92b641d1 01 July 2020, 18:16:08 UTC
b823f25 Amanpreet Singh 01 July 2020, 17:59:27 UTC [fix] VisualBERT regression of pooler; provide pooler strategy option (#377) Summary: - In VQA2 and general question answering, original codebase has a different pooler strategy of taking hidden state from second last token - The regression was causing issue with mismatch of accuracies on pretraining it right paper's checkpoint Pull Request resolved: https://github.com/facebookresearch/mmf/pull/377 Test Plan: Testing on the best checkpoint and estimated the accuracy to be same. Reviewed By: vedanuj Differential Revision: D22328981 Pulled By: apsdehal fbshipit-source-id: bcd289181289e500c29d3fd73e1a8600f0ce5b3d 01 July 2020, 18:00:37 UTC
48c0d58 omkar 01 July 2020, 17:58:35 UTC Working training 01 July 2020, 17:58:35 UTC
d1d10cb Vedanuj Goswami 01 July 2020, 07:07:15 UTC [feat] Add MoViE+MCAN model (#345) Summary: - Adding the MoVie+MCAN model (VQA 2020 Challenge Winner) TODOs: - [x] Add typings to movie_mcan.py - [x] Upload the annotations to zoo - [x] Upload best model to zoo - [x] Cleanup feature_readers.py - [x] Update Readme Pull Request resolved: https://github.com/facebookresearch/mmf/pull/345 Reviewed By: apsdehal Differential Revision: D22214947 Pulled By: vedanuj fbshipit-source-id: 99da94efdbf34b74338b62299570a299860cb6d1 01 July 2020, 07:08:33 UTC
a1a1a55 Amanpreet Singh 01 July 2020, 06:41:20 UTC [fix] Reloads in spawned processes shouldn't setup imports again (#374) Summary: - Fixes https://github.com/facebookresearch/mmf/issues/355 partially - In general, only setup_imports in the main processor - This means that the child processes are using only shallow registry which is fine as setup imports can cause issues in file not related with syntax error - Overall, this can't be fixed completely as by the nature of the spawn, the child will still reload all of the code and if a syntax error is there it will still break the worker. General suggestion is to keep two copies of the code, one for development and one for running and keep them in sync via GitHub Pull Request resolved: https://github.com/facebookresearch/mmf/pull/374 Test Plan: Tested with command and reproduction steps provided by Ronghang Reviewed By: vedanuj Differential Revision: D22322313 Pulled By: apsdehal fbshipit-source-id: 6a8e388df1244ff450f726bc66535ff53900da14 01 July 2020, 06:42:39 UTC
208579e Amanpreet Singh 30 June 2020, 22:17:38 UTC [docs] Tutorial on SLURM sweeps (#359) Summary: - Runs prettier on rest of docs as well - Point original readme to the new doc Pull Request resolved: https://github.com/facebookresearch/mmf/pull/359 Reviewed By: vedanuj Differential Revision: D22310372 Pulled By: apsdehal fbshipit-source-id: 4b3e61097fba319d8ea05c7e7d2cfda3d7074593 30 June 2020, 22:18:54 UTC
f021a7a Amanpreet Singh 30 June 2020, 21:53:03 UTC [fix] Resolve config when it is created (#371) Summary: - Fixes https://github.com/facebookresearch/mmf/issues/370. See it for details Pull Request resolved: https://github.com/facebookresearch/mmf/pull/371 Test Plan: Tested with visual bert run Reviewed By: vedanuj Differential Revision: D22297254 Pulled By: apsdehal fbshipit-source-id: 1a6549774dacf2f8cda492c9d2092b2ce42ccba7 30 June 2020, 21:54:11 UTC
025f05d Durgesh 30 June 2020, 16:28:20 UTC [fix] Installation Link in hateful_memes/README.md (#368) Summary: Broken Link in hateful_memes/README.md for mmf installation Fix Pull Request resolved: https://github.com/facebookresearch/mmf/pull/368 Reviewed By: apsdehal Differential Revision: D22291475 Pulled By: vedanuj fbshipit-source-id: 239ab1891576d234c8a146826e3999298474cc7a 30 June 2020, 16:29:19 UTC
b620c01 Vedanuj Goswami 30 June 2020, 16:25:26 UTC [fix] Rename imdb to annotation_db (#372) Summary: Renames remaining `imdb` to `annotation_db` Pull Request resolved: https://github.com/facebookresearch/mmf/pull/372 Reviewed By: apsdehal Differential Revision: D22304951 Pulled By: vedanuj fbshipit-source-id: 47ead15b4741d1c0628782951cc3232992d444c7 30 June 2020, 16:26:28 UTC
48631d8 Vedanuj Goswami 30 June 2020, 03:57:09 UTC [feat, refactor] Trainer class refactor (#332) Summary: PR refactors the trainer class providing flexibility to extend from the BaseTrainer class and customize it. We also introduce a callback mechanism that can be executed at different events during training, validation or inference. Hence separates most of the logic of core training/optimization from other logistics. - Create an abstract base trainer class, and core functionalities like loading dataset, model, optimizer, metrics are abstract methods that has to be implemented by derived classes. - Create a new `MMFTrainer` class which keeps the same behavior as the current trainer but derived from the `BaseTrainer`. - Move core logic of training loop, evaluation loop and prediction loop to Mixin classes and can be easily used in trainer classes. - Create a callback mechanism similar to `PytorchLightning` with different types of events when callbacks can happen. With this it will be easier to have `PytorchLightning` supported trainer classes for `mmf` - Callbacks are executed before or after events like training, validation, test, batch, epoch etc. - Typing introduced in the trainer classes - There can be some additional refactoring around how to include some additional callbacks like Early Stopping in the hooks, but that can be done in future diffs. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/332 Test Plan: - Tested training, inference, validation runs, checked if events are happening in correct order with the new callback mechanism. Reviewed By: apsdehal Differential Revision: D22112333 Pulled By: vedanuj fbshipit-source-id: 07dbd42962691cf6b64bca2d53dc98f17150c853 30 June 2020, 03:58:20 UTC
eeb2f3a Devi Parikh 30 June 2020, 00:07:58 UTC [docs] Minor edits in quickstart docs (#361) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/361 Reviewed By: vedanuj, apsdehal Differential Revision: D22247164 Pulled By: deviparikh fbshipit-source-id: eb4769cd8f0db8fa9e2f4e0d7dfcfd17e6b45374 30 June 2020, 00:09:10 UTC
b796c62 Devi Parikh 30 June 2020, 00:05:48 UTC [docs] Minor edits in FAQ docs (#362) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/362 Reviewed By: vedanuj, apsdehal Differential Revision: D22247129 Pulled By: deviparikh fbshipit-source-id: 6268f6e59a487b54dfd73c889d64b73635437b46 30 June 2020, 00:07:11 UTC
6369480 Devi Parikh 29 June 2020, 23:58:44 UTC [docs] Minor edits in features docs (#360) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/360 Reviewed By: vedanuj, apsdehal Differential Revision: D22247167 Pulled By: deviparikh fbshipit-source-id: fd374508b68fe3b498db3faab76abbec71ccd8c3 29 June 2020, 23:59:51 UTC
895624a Amanpreet Singh 29 June 2020, 22:25:22 UTC [fix] VQA Answer Processor in case of predict; vocab path (#363) Summary: - In case answers are not present, don't call answer processor - Predcition now requires EOS_IDX, which is not present in VQAAnswerProcessor, so let's add that - Use `get_absolute_path` for proper path search of vocabs - Fixes https://github.com/facebookresearch/mmf/issues/341 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/363 Test Plan: Tested predict end to end for lorra model Reviewed By: vedanuj Differential Revision: D22258244 Pulled By: apsdehal fbshipit-source-id: df2f630b1536b9bea75d6e2a0a2e712bf3834f2e 29 June 2020, 22:26:55 UTC
ec617aa omkar 29 June 2020, 18:33:35 UTC Addressing review comments 29 June 2020, 18:33:35 UTC
e681e8d Vedanuj Goswami 29 June 2020, 17:59:18 UTC [fix] Check for distributed is_available (#365) Summary: Fixes https://github.com/facebookresearch/mmf/issues/353 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/365 Reviewed By: apsdehal Differential Revision: D22266850 Pulled By: vedanuj fbshipit-source-id: ed45963dae38c3157ee6eaa3cdcab2607cd5a1a9 29 June 2020, 18:01:02 UTC
bede205 omkar 27 June 2020, 01:35:26 UTC Merge branch 'vilbert_multitask_flickr30k' of github.com:facebookresearch/mmf into vilbert_multitask_flickr30k 27 June 2020, 01:35:26 UTC
1703550 omkar 26 June 2020, 03:54:50 UTC Merge branch 'vilbert_multitask_flickr30k' of github.com:facebookresearch/mmf into vilbert_multitask_flickr30k 27 June 2020, 01:33:56 UTC
9f7b87d Vedanuj Goswami 26 June 2020, 04:26:54 UTC [feat] Add GQA dataset (#349) Summary: - Adds the GQA dataset and Masked GQA dataset Required for https://github.com/facebookresearch/mmf/issues/339 LXMERT model pretraining and downstream task Pull Request resolved: https://github.com/facebookresearch/mmf/pull/349 Test Plan: - Test for VisualBERT model Reviewed By: apsdehal Differential Revision: D22179321 Pulled By: vedanuj fbshipit-source-id: 107d6dddd3b16edfeb4437fc2dd4b431ebb2513a 26 June 2020, 04:28:04 UTC
40ed903 omkar 26 June 2020, 03:54:50 UTC Merge branch 'vilbert_multitask_flickr30k' of github.com:facebookresearch/mmf into vilbert_multitask_flickr30k 26 June 2020, 03:54:50 UTC
0907f20 omkar 26 June 2020, 03:51:03 UTC Database Implementation for Flickr30k 26 June 2020, 03:53:19 UTC
072669b omkar 26 June 2020, 03:51:03 UTC Database Implementation for Flickr30k 26 June 2020, 03:51:03 UTC
e93ba44 Vedanuj Goswami 25 June 2020, 23:58:09 UTC [feat, fix] Add tests for Windows, fix windows issues (#352) Summary: - Fix distributed issues on windows which don't support - Fix issues with log file closing after test, log file name - Fix issues with Timer format on Windows - Fix issues with loss mocking which should be changed to original class for subsequent tests (issue only in Windows) - Fix actions to run on branch specific code - Cache windows env in actions and install dependencies separately - Skip few tests for download on macos and windows which are flaky Pull Request resolved: https://github.com/facebookresearch/mmf/pull/352 Test Plan: - Run tests Reviewed By: apsdehal Differential Revision: D22203290 Pulled By: vedanuj fbshipit-source-id: f15cf293918abd979564858da3360d0f15cfac92 26 June 2020, 00:00:20 UTC
a595deb Amanpreet Singh 25 June 2020, 20:51:16 UTC [fix] Doc authors on github pages deploy (#358) Summary: - Fetch all history in github checkout history to fix this - Fixes https://github.com/facebookresearch/mmf/issues/357 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/358 Reviewed By: vedanuj Differential Revision: D22220057 Pulled By: apsdehal fbshipit-source-id: 806d2ab3c8167c7a148ae7017fb6dab763a02cbb 25 June 2020, 20:54:21 UTC
be5fe0d Devi Parikh 24 June 2020, 21:34:31 UTC [fix] Makes minor edits (#354) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/354 Reviewed By: apsdehal Differential Revision: D22203893 Pulled By: vedanuj fbshipit-source-id: 637d484116feb9b85008bef30b1b6c7e6ccdb663 24 June 2020, 21:35:48 UTC
844e167 Shir Gur 24 June 2020, 18:30:02 UTC [fix] Remove hashcode from flickr30k images (#356) Summary: The old hashcode was different than the once generated by the downloaded file Pull Request resolved: https://github.com/facebookresearch/mmf/pull/356 Reviewed By: apsdehal Differential Revision: D22209769 Pulled By: vedanuj fbshipit-source-id: cbe2c6fed8abf492259812aa1e58e8638af6361a 24 June 2020, 18:31:40 UTC
c0812e9 Vedanuj Goswami 22 June 2020, 16:11:35 UTC [fix] Fix when no logger is initialized (#344) Summary: Fixes https://github.com/facebookresearch/mmf/issues/338 - Send logs to stdout when processor is called and no logger is registered. This is done because Logger cannot be initialized without training config. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/344 Test Plan: Test with textvqa loading using build_dataset that requires fasttext download. Reviewed By: apsdehal Differential Revision: D22128318 Pulled By: vedanuj fbshipit-source-id: e11c66c96170fe207474b21c0c33360c90863374 22 June 2020, 16:12:42 UTC
0a3f9f8 David Szabo 20 June 2020, 02:39:35 UTC [fix] Naming of OCR bounding box positions in utils/dataset level (#335) Summary: Related issue: https://github.com/facebookresearch/mmf/issues/328 I ran into an error when I extended the default config file (mmf/projects/lorra/configs/textvqa/defaults.yaml) by the following properties: ``` dataset_config: textvqa: use_ocr: true use_order_vectors: true return_features_info: true use_ocr_info: true ``` The corresponding command: ``` python mmf/mmf_cli/run.py config=mmf/projects/lorra/configs/textvqa/defaults.yaml \ datasets=textvqa \ model=lorra \ run_type=train_val ``` The solution aims to fix the naming issue. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/335 Reviewed By: vedanuj Differential Revision: D22146987 Pulled By: apsdehal fbshipit-source-id: 3f3ef1aa815009e7d1165a8bffd1789d19bc05de 20 June 2020, 02:41:02 UTC
61524c3 omkar 20 June 2020, 00:05:06 UTC Initial commit 20 June 2020, 00:05:06 UTC
df4eb01 Amanpreet Singh 19 June 2020, 23:16:15 UTC [fix,enhance] Simplify the env import lib detection logic (#342) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/342 Simplifies the logic used to detect files on run without any opinions Moves visual dialog scripts to tools Reviewed By: vedanuj Differential Revision: D22108360 fbshipit-source-id: aa3fdeefc7188c3c340d95325762bf6570ece8c4 19 June 2020, 23:20:43 UTC
7464618 Vedanuj Goswami 17 June 2020, 17:07:01 UTC [feature] Add CPU tests to Actions (#329) Summary: - Add CPU tests to Github Actions. - Run a matrix : Ubuntu/Mac OS, Python 3.7, 3.8 - Proper caching of conda envs for both Linux and Mac - Test results are uploaded as artifacts - Linters(black, isort, flake8) will be added in a separate actions workflow for more clarity to developers where test fails. So not included with CPU tests here. - CPU tests will be removed from Circle CI in subsequent PRs once we verify Actions is reliable - We cannot run tests for Windows yet as torch.distributed is not supported properly. Our tests can be fixed later if Windows tests are required and we can add `windows-latest` to the matrix. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/329 Test Plan: - Tested Actions on this branch Reviewed By: apsdehal Differential Revision: D22036911 Pulled By: vedanuj fbshipit-source-id: 731941f67665db38ea7fa4f44305db12c85603a3 17 June 2020, 17:08:19 UTC
dca3ec3 Amanpreet Singh 17 June 2020, 04:56:12 UTC [docs] Fix M4C docs and move them to website for new api (#324) Summary: - Move docs to projects url in website - Fix docs according to new API Pull Request resolved: https://github.com/facebookresearch/mmf/pull/324 Test Plan: Deployed the website locally Reviewed By: vedanuj Differential Revision: D22029100 Pulled By: apsdehal fbshipit-source-id: f95c171da11fea3ab354d023e2429d61a35751fc 17 June 2020, 04:57:04 UTC
c67c759 Amanpreet Singh 17 June 2020, 04:48:11 UTC [fix] VQA Answer Processor for missing answers from TextVQA (#334) Summary: - Fixes https://github.com/facebookresearch/mmf/issues/331 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/334 Reviewed By: vedanuj Differential Revision: D22062865 Pulled By: apsdehal fbshipit-source-id: 85d7848f9748dbc8121368ea376c8f4011b32609 17 June 2020, 04:49:54 UTC
eed2140 Woojeong Jin 16 June 2020, 21:13:53 UTC [feat] Support image features for MMBT on MMIMDB (#333) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/333 Support image features for MMBT on the MMIMDB dataset. I have modified configs for MMIMDB, and make them consistent with configs for Hateful-memes. defaults.yaml is for image grid features, with_features.yaml is for region features. To support this, I have made MMIMDbFeaturesDataset and MMIMDbImageDataset classes Reviewed By: apsdehal Differential Revision: D22056638 fbshipit-source-id: 5e52a2058c5670dac3d6a0d77e31343447d0da56 16 June 2020, 21:15:03 UTC
f30d62b Vedanuj Goswami 16 June 2020, 19:07:55 UTC [docs] Adding a new model documentation (#322) Summary: - Add a doc for adding a new model. Uses Concat BERT Pull Request resolved: https://github.com/facebookresearch/mmf/pull/322 Reviewed By: apsdehal Differential Revision: D22047466 Pulled By: vedanuj fbshipit-source-id: 7db858f5c07174f88b099074d2dba1beb6021fa7 16 June 2020, 19:11:49 UTC
1e94561 Vedanuj Goswami 16 June 2020, 19:07:37 UTC [docs] Add Processor tutorial (#294) Summary: - Adds a tutorial for Processors, three types : simple text, simple image and text processor inheriting from a vocab processor - Fixes processor docs - Properly showing doc string and including all processors (image and bert as well) Pull Request resolved: https://github.com/facebookresearch/mmf/pull/294 Test Plan: - Tested by building docs locally Reviewed By: apsdehal Differential Revision: D21901984 Pulled By: vedanuj fbshipit-source-id: b365ff47a7b37e13c061c564c2fe8b232111cc03 16 June 2020, 19:08:59 UTC
f786468 Vedanuj Goswami 16 June 2020, 07:55:55 UTC [fix] CircleCI : Bump nvidia driver to CUDA 10.2 (#325) Summary: - Bump nvidia driver to CUDA 10.2 so that it works with default pip install of torch (one that most users will be using when they set up the package) - Nvidia driver for CUDA 10.2 is available from Pytorch CI assets (not yet on Nvidia's AWS) - Use python 3.7 in all environments Pull Request resolved: https://github.com/facebookresearch/mmf/pull/325 Test Plan: - Check GPU tests are running Reviewed By: apsdehal Differential Revision: D22033827 Pulled By: vedanuj fbshipit-source-id: 936b2dbd486aaaa313d9bcc4f08d97b2ccee6a14 16 June 2020, 07:57:00 UTC
2f72495 Vedanuj Goswami 16 June 2020, 07:47:22 UTC [docs] Add Model and Dataset (list) (#327) Summary: - Added list of models with arxiv and project page links. Currently it just list the models we have. Proper way to create a model zoo doc will be to add performance numbers of models on different datasets. - Added list of datasets with papers and website links Pull Request resolved: https://github.com/facebookresearch/mmf/pull/327 Reviewed By: apsdehal Differential Revision: D22033831 Pulled By: vedanuj fbshipit-source-id: 12d7dfdeba2d0784ea7f9a98ac16d80947e55c38 16 June 2020, 07:48:46 UTC
8f94bfd Vedanuj Goswami 16 June 2020, 07:16:44 UTC [docs, fix] Update some more docs and fixes (#326) Summary: - Update Quickstart with more details - Fix broken links - Update to use bash code block Pull Request resolved: https://github.com/facebookresearch/mmf/pull/326 Reviewed By: apsdehal Differential Revision: D22033830 Pulled By: vedanuj fbshipit-source-id: ac415e56eff2cb5bf7e14b05460e68cd16b7c984 16 June 2020, 07:18:01 UTC
a6c6b46 Vedanuj Goswami 12 June 2020, 21:42:09 UTC [docs] Add challenge pages for VQA and TextVQA (#321) Summary: - Added tutorials for VQA Challenge and TextVQA Challenge - Remove Other Challenges page Pull Request resolved: https://github.com/facebookresearch/mmf/pull/321 Reviewed By: apsdehal Differential Revision: D22013845 Pulled By: vedanuj fbshipit-source-id: cf0aa797fa2a3373fca9651a671caa81ab728ec8 12 June 2020, 21:43:31 UTC
c02a63d Amanpreet Singh 12 June 2020, 21:34:44 UTC [fix] Add new hm checksum and disable dark mode, link to blog (#323) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/323 Reviewed By: vedanuj Differential Revision: D22021868 Pulled By: apsdehal fbshipit-source-id: 444c66eac783136292c0cf11606c30a337d6cbc8 12 June 2020, 21:36:11 UTC
ba9c21b Amanpreet Singh 12 June 2020, 21:26:44 UTC [feature] Automatic gh-pages deployment using github actions (#320) Summary: - Caches conda and node modules - Uses all best practices such as miniconda etc. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/320 Test Plan: Tested using a private repo Reviewed By: vedanuj Differential Revision: D21993405 Pulled By: apsdehal fbshipit-source-id: 5370d4b2078857cfc158189ada43baa935c6047c 12 June 2020, 21:28:26 UTC
2e4acaa Vedanuj Goswami 12 June 2020, 09:21:28 UTC [fix] Fix test reporter for vqa (#315) Summary: - Fixes test reporter when image_id has one dimension Pull Request resolved: https://github.com/facebookresearch/mmf/pull/315 Test Plan: Test generating predictions for vqa Reviewed By: apsdehal Differential Revision: D21976149 Pulled By: vedanuj fbshipit-source-id: c8d4ccfb26f076021aae5335ebb4ae7950d0def3 12 June 2020, 09:25:23 UTC
cee5699 Vedanuj Goswami 12 June 2020, 09:11:55 UTC [docs] Add checkpoint tutorial (#310) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/310 Reviewed By: apsdehal Differential Revision: D22008303 Pulled By: vedanuj fbshipit-source-id: 59cd5e16e25bdf5af5e0b35e3da640330da5e14c 12 June 2020, 09:14:13 UTC
fee438e Vedanuj Goswami 12 June 2020, 04:55:53 UTC [fix] Fix vqa vocab paths (#317) Summary: Fix paths for vocab files in default config Pull Request resolved: https://github.com/facebookresearch/mmf/pull/317 Test Plan: Check paths are picked up properly and run training Reviewed By: apsdehal Differential Revision: D21976136 Pulled By: vedanuj fbshipit-source-id: ccf3886edea0d215c9683e54c6ff1ef98923ba63 12 June 2020, 04:58:31 UTC
df17eb7 Amanpreet Singh 11 June 2020, 20:58:21 UTC [fix] Sleep and retry zoo tests for more stability (#318) Summary: - Zoo tests have recently become flaky - This tries a url three times with sleep in between before giving up Pull Request resolved: https://github.com/facebookresearch/mmf/pull/318 Test Plan: Test locally Reviewed By: vedanuj Differential Revision: D21987290 Pulled By: apsdehal fbshipit-source-id: 6ea124ac3e1ebff82e308196bfe986e2060c7ea9 11 June 2020, 21:01:08 UTC
2a2f0ff Vedanuj Goswami 11 June 2020, 19:31:40 UTC [docs] Update citation (#313) Summary: Updating the citation in Readme and docs. Removed citation from Quickstart. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/313 Reviewed By: apsdehal Differential Revision: D22002345 Pulled By: vedanuj fbshipit-source-id: 9546b6dff97df54cf74dfb5ecc2236719488a610 11 June 2020, 19:34:58 UTC
d0147a4 Amanpreet Singh 11 June 2020, 16:13:22 UTC [chores] Update README, features page; add projects page (#319) Summary: - Includes video and current logo in README - Adds projects page Pull Request resolved: https://github.com/facebookresearch/mmf/pull/319 Reviewed By: vedanuj Differential Revision: D21990833 Pulled By: apsdehal fbshipit-source-id: c3a6a1128c9799ee871a6fde11397d7c5c9451dd 11 June 2020, 16:15:52 UTC
cd9ca91 Amanpreet Singh 10 June 2020, 22:38:21 UTC [enhancement] Integrate docs into website; css fixes and others (#314) Summary: - Moves all docs from api to website - Add google analytics - Keep only api docs on api website - Style fixes and beautify the website for night and normal mode - Deploy issues on API static with nojekyll - Logo updates Pull Request resolved: https://github.com/facebookresearch/mmf/pull/314 Test Plan: Tested locally through website build instructions Reviewed By: vedanuj Differential Revision: D21968408 Pulled By: apsdehal fbshipit-source-id: f8b660ec6c262d9531dc255bdcc53bd8b2febf12 10 June 2020, 22:41:07 UTC
45742b7 Amanpreet Singh 10 June 2020, 05:38:51 UTC [feat] Launch api for run and predict for programmatic mmf launch (#308) Summary: - Adds ability to run "run" and "predict" command programmatically Pull Request resolved: https://github.com/facebookresearch/mmf/pull/308 Test Plan: Tested through local jupyter notebook Reviewed By: vedanuj Differential Revision: D21941000 Pulled By: apsdehal fbshipit-source-id: 38841ffb5a8763c11c47a81290301cabdcb216bc 10 June 2020, 05:41:00 UTC
7026ab4 Amanpreet Singh 09 June 2020, 20:30:10 UTC [fix] Ckpt zoo load, restore and other issues (#311) Summary: - Explictly have an option for loading zoo in _load function - This fixes the issues with restore and other loading when resume_zoo is specified Pull Request resolved: https://github.com/facebookresearch/mmf/pull/311 Reviewed By: vedanuj Differential Revision: D21958031 Pulled By: apsdehal fbshipit-source-id: b13ea97c6edf75e3b60f91279337e6430daddc6f 09 June 2020, 20:33:07 UTC
2a80b66 Amanpreet Singh 09 June 2020, 20:11:50 UTC [fix] Sdist build and add bypass_checksum feature for hm_convert (#309) Summary: - We need Manifest.in for now; later we should move requirements to setup.py directly - Because of missing manifest, requirements.txt wasn't copied and caused issue https://github.com/facebookresearch/mmf/issues/299. Fixes https://github.com/facebookresearch/mmf/issues/299 properly - Updates requirements for numpy and tqdm to be more lenient - Add bypass_checksum option for people who are having issues with checksum. Thus, fixes https://github.com/facebookresearch/mmf/issues/261 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/309 Test Plan: Both options that were added have been tested properly locally on devfair Reviewed By: vedanuj Differential Revision: D21958993 Pulled By: apsdehal fbshipit-source-id: 383203d025324d36e747d964345ba8d589f71923 09 June 2020, 20:13:43 UTC
2165feb Amanpreet Singh 09 June 2020, 19:53:28 UTC [fix] Pretrain config for mmimdb (#301) Summary: This fixes mmimdb config for pretraining. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/301 Reviewed By: vedanuj Differential Revision: D21923960 Pulled By: apsdehal fbshipit-source-id: 3179702d38f78b41c492210fd4e49c5915521715 09 June 2020, 19:55:26 UTC
9a96e5e Vedanuj Goswami 09 June 2020, 19:34:22 UTC [docs] Update readme for Hateful Memes with more instructions (#296) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/296 Reviewed By: apsdehal Differential Revision: D21910249 Pulled By: vedanuj fbshipit-source-id: 555794b47e20e22aae98cb11535795e7a354abbd 09 June 2020, 19:36:30 UTC
9bbcc40 Omkar Parkhi 08 June 2020, 23:22:40 UTC [fix] Tensorboard logging folder fix and Database visualization fix (#307) Summary: - Fixes log_folder attribute in TensorBoard logging - Fixes visualization when resize sizes are specified Pull Request resolved: https://github.com/facebookresearch/mmf/pull/307 Reviewed By: apsdehal Differential Revision: D21939755 Pulled By: omkar-fb fbshipit-source-id: 7ca44e1a680582ae0f0b210cbae8e1d734b94921 08 June 2020, 23:24:38 UTC
1f7be78 Vedanuj Goswami 06 June 2020, 07:34:51 UTC [fix] mmimdb dataset fixes (#297) Summary: - Update paths and proper annotation files Test Plan : Test with mmimdb training starting with no cache Pull Request resolved: https://github.com/facebookresearch/mmf/pull/297 Reviewed By: apsdehal Differential Revision: D21918955 Pulled By: vedanuj fbshipit-source-id: 161d9966ae11a2376daf855a8c563d06ae86ee5f 06 June 2020, 07:36:40 UTC
9e778dc Vatsal Goel 05 June 2020, 18:15:39 UTC [tests] Fix device error in checkpoint test (#257) Summary: There was an error in running pytest ./tests that it expected cuda object but received cpu object. This PR assigns right device to the object tested according to the weight's device. Fixes #293 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/257 Reviewed By: vedanuj Differential Revision: D21900928 Pulled By: apsdehal fbshipit-source-id: 3a06416f3bc3e4233e01339a0536b30b35d08b6c 05 June 2020, 18:18:11 UTC
f11adf0 Vedanuj Goswami 03 June 2020, 19:26:08 UTC [feature, fix] Capture stdout in logger, fix logger initialization (#284) Summary: This PR addresses several logger related issues - Capture `stdout` by the logger. Adds a StreamToLogger class to write `stdout` to logger. Behavior can be overridden using config `training.stdout_capture`. - Remove sending the writer/warning logs to stdout when we are capturing stdout logs in the logger - Refactor out `build_config` as a separate method and decouple from `build_trainer`. - Adds basic tests to check log files are created in proper place - Fixes slurm script Pull Request resolved: https://github.com/facebookresearch/mmf/pull/284 Reviewed By: apsdehal Differential Revision: D21856097 Pulled By: vedanuj fbshipit-source-id: e6b312f410e084bf1bb51280712e2de3666e173e 03 June 2020, 19:30:31 UTC
168d78f Vedanuj Goswami 03 June 2020, 17:57:19 UTC [fix] Fix Hateful Memes output format (#289) Summary: Fixes https://github.com/facebookresearch/mmf/issues/288 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/289 Reviewed By: apsdehal Differential Revision: D21862440 Pulled By: vedanuj fbshipit-source-id: b11bbd0c4d5c3ee5362924f58a7f4cb434288a8a 03 June 2020, 17:58:37 UTC
23898ef Amanpreet Singh 03 June 2020, 04:22:53 UTC [feature] Add MMF website, unify docs; move docs to pytorch_sphinx_theme (#287) Summary: - Adds website based on docusaurus 2 - Uses Pytorch Sphinx Theme with a custom version of it - Unify docs into the website - Add first version of the landing page - Adapt all of the links to mmf - Add redirect to api as well TODOs in next PR: - Add versioning support - Add continuous integration checks for website - Add continuous integration deploy for website - Setup rest of the stuff regarding website deploy Pull Request resolved: https://github.com/facebookresearch/mmf/pull/287 Reviewed By: vedanuj Differential Revision: D21849352 Pulled By: apsdehal fbshipit-source-id: 154f8c1455d7e5054cafc70eda1eb25ec2fe3b21 03 June 2020, 04:27:17 UTC
ad32366 Vedanuj Goswami 03 June 2020, 00:53:40 UTC [chores] Update project readme files (#286) Summary: - Add project Readme for MMBT - Update BAN, BUTD, Lorra, Pythia, Vilbert, Visual BERT readme files Pull Request resolved: https://github.com/facebookresearch/mmf/pull/286 Reviewed By: apsdehal Differential Revision: D21835976 Pulled By: vedanuj fbshipit-source-id: 10125790ffe4d7f70fa6a2a9648e3fa605a312ab 03 June 2020, 00:54:55 UTC
7f3692f Amanpreet Singh 02 June 2020, 16:43:12 UTC [fix] phoc build during setup.py (#285) Summary: - Also specifies the exact variation for detectron weights - Builds the cphoc extension properly in setup.py Pull Request resolved: https://github.com/facebookresearch/mmf/pull/285 Reviewed By: vedanuj Differential Revision: D21835564 Pulled By: apsdehal fbshipit-source-id: 6ecc71fb008c4ca82064d02556b546486df08752 02 June 2020, 16:45:05 UTC
3734880 Amanpreet Singh 01 June 2020, 19:08:16 UTC [feature] MMBT Interface for pretrained models (#278) Summary: - Add interface for MMBT which has classify function - Create build_processors function for easy use with interfaces - Allow no_tqdm in download - Add tests for these interfaces Pull Request resolved: https://github.com/facebookresearch/mmf/pull/278 Test Plan: Added tests for testing the pretrained model Reviewed By: vedanuj Differential Revision: D21773357 Pulled By: apsdehal fbshipit-source-id: 58fc98fbe5580ecb14d95bf90f6880a5272a9315 01 June 2020, 19:10:28 UTC
7084ae5 Amanpreet Singh 01 June 2020, 16:38:24 UTC [feat] Automatic downloads for VQA2,COCO,CC,SNLI,VizWiz (#282) Summary: - Updates configs for pretraining project - Updates default configs to use automatic download paths - Updates README as well Pull Request resolved: https://github.com/facebookresearch/mmf/pull/282 Test Plan: Tested with zoo test Reviewed By: vedanuj Differential Revision: D21808251 Pulled By: apsdehal fbshipit-source-id: 51a7b5c9c4de83a10a2af42862f107388a1ffe8c 01 June 2020, 16:41:26 UTC
d176851 Vedanuj Goswami 30 May 2020, 01:00:12 UTC [mmf] Fblearner changes for Hateful Memes, HM sweep script, some fixes (#281) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/281 Pull Request resolved: https://github.com/fairinternal/mmf-internal/pull/121 - Added new squashfs hateful_memes.img to `/mnt/fair/hateful_memes.img` and `/mnt/fair-flash3-east/hateful_memes.img` . This contains all data files necessary for hateful memes v5 - Added Hateful Memes sweep script for mmbt. This can be modified to run with other models - set env variable for `TORCH_HOME` to read cached files for models, tokenizer configs etc. - add `projects` files to target so that fblearner can find relative configs - fblearner fixes after file name was changed Reviewed By: mamhamed Differential Revision: D21759302 fbshipit-source-id: eec83b519a46b7e0c05c465836e1a9309e71031a 30 May 2020, 01:02:18 UTC
08e5416 Vedanuj Goswami 28 May 2020, 01:07:44 UTC [docs] Update Quickstart documentation (#277) Summary: Fixes https://github.com/facebookresearch/mmf/issues/272 #276 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/277 Reviewed By: apsdehal Differential Revision: D21734443 Pulled By: vedanuj fbshipit-source-id: 3d3488a3eb4cbd11e042cc6fd9c3487e1d42c9dc 28 May 2020, 01:10:27 UTC
6495f7d Amanpreet Singh 26 May 2020, 17:14:48 UTC [fix] Regression due to OmegaConf upgrade in pop (#275) Summary: - Fixes https://github.com/facebookresearch/mmf/issues/274 - Side: Fix Load pretrained command in readme - Side: Fix precommit warning Pull Request resolved: https://github.com/facebookresearch/mmf/pull/275 Reviewed By: vedanuj Differential Revision: D21710272 Pulled By: apsdehal fbshipit-source-id: b7a8dcd68ffd48e9bc6d18be9d69bb46aef8420a 26 May 2020, 17:16:37 UTC
6d89e1d Amanpreet Singh 23 May 2020, 03:51:43 UTC [chore] Add licenses to files missing it along with precommit hook (#270) Summary: - Adds pre-commit hook to automatically detect and add license if missing - Updates all of the current files Pull Request resolved: https://github.com/facebookresearch/mmf/pull/270 Reviewed By: vedanuj Differential Revision: D21706344 Pulled By: apsdehal fbshipit-source-id: 8cfb706015868817228401157884c01c7b2dd4a5 23 May 2020, 03:53:30 UTC
e5d7964 Amanpreet Singh 23 May 2020, 00:32:41 UTC [feat,refactor] build,visualize dataset; refactor MultiDataset, fix HM (#267) Summary: - Adds builder utils for dataset and dataset loader - setup_imports now have a check whether they were already setup and always happen in the case of registry import - Add typings file which contains multiple typings used build - Adds visualize function to hateful memes dataset and to base dataset class as well which can be overriden in the child datasets - MultiDataset has been refactored to be more clean and use build utils added in this PR. - MultiDataset has been renamed to MultiDatasetLoader as it is actually a loader and not a dataset - Change accordingly in trainer - Move setup imports function to env as that is the correct location - Adds function load_yaml_with_defaults which will merge the yaml passed with default MMF configuration file - Adds option to image database's from_path function to not apply transform - Adds a new utils file visualize which contains visualize_images function as of now - HM dataset fix: Should not return target in case where label is not present Pull Request resolved: https://github.com/facebookresearch/mmf/pull/267 Test Plan: Test with regular visual_bert on hateful_memes command, pip install and then test in jupyter notebook Reviewed By: vedanuj Differential Revision: D21680440 Pulled By: apsdehal fbshipit-source-id: d8458495c4af84b0cf53067fdfb7c7f0ea591d42 23 May 2020, 00:34:11 UTC
3e192ea Amanpreet Singh 22 May 2020, 21:16:34 UTC [feat] SampleList pin_memory and to_dict (#271) Summary: - Adds pin_memory to properly pin_memory in case of custom batch - Adds to_dict which will be useful for torchscript Pull Request resolved: https://github.com/facebookresearch/mmf/pull/271 Test Plan: Adds tests to test these two on SampleList Reviewed By: vedanuj Differential Revision: D21701640 Pulled By: apsdehal fbshipit-source-id: 61752032364cf63231dc9246953ed6066593653c 22 May 2020, 21:18:13 UTC
396cd0e Amanpreet Singh 22 May 2020, 20:55:38 UTC [fix,refactor] Upgrade to Python3.6+ syntax and pyupgrade hook (#269) Summary: - Upgrade to Python3.6+ syntax - Use pyupgrade pre-commit hook to make sure everything stays on same version Pull Request resolved: https://github.com/facebookresearch/mmf/pull/269 Reviewed By: vedanuj Differential Revision: D21699916 Pulled By: apsdehal fbshipit-source-id: 2e70682e508da05166e09a9439974ac6344f0d85 22 May 2020, 20:57:19 UTC
9cc6cbc Vedanuj Goswami 22 May 2020, 04:26:23 UTC [chores, fix] Add pretrain VL right models to zoo, fixes for masked datasets (#263) Summary: - Adds all pretrained models for Pretrain VL project - Fixes masked coco dataset - Add few missing configs symlinks - Fix few configs for train+val Pull Request resolved: https://github.com/facebookresearch/mmf/pull/263 Reviewed By: apsdehal Differential Revision: D21658125 Pulled By: vedanuj fbshipit-source-id: cab72c0e9e7cda48d8bb0476585e4719220a5579 22 May 2020, 04:28:16 UTC
7cb8334 Vedanuj Goswami 22 May 2020, 04:10:38 UTC [chores] Upgrade to Pytorch 1.5, torchvision 0.6 (#265) Summary: - Upgrade to Pytorch 1.5, torchvision 0.6 - Update setup.py and hence rc version - Update CircleCI for windows build test. Since windows instance we are using does not have GPU enabled we install cpu version of torch only. Tests: - Tests passing - Tested with VisualBERT model training Pull Request resolved: https://github.com/facebookresearch/mmf/pull/265 Reviewed By: apsdehal Differential Revision: D21682111 Pulled By: vedanuj fbshipit-source-id: 8fafeeecec2aae118d4aa31cdb4e08a2e34e1500 22 May 2020, 04:12:05 UTC
17495ad Amanpreet Singh 20 May 2020, 22:02:22 UTC [fix,refactor] Add mmf_cli cmds, fix,speed up hm_convert, pip package (#262) Summary: - Python zipfile module uses Python interpretation to unzip files which are encrypted; so improve performance we first use unzip command if present otherwise fall back to zipfile implementation - Bump the version number - Add a new folder mmf_cli which will contain all cli commands in one place but usually should symlink to tools folder - Add proper __init__.py files for folder which were not getting imported properly - get_absolute_path now actually returns absolute path if the path is not uri instead of directly returning the path. This fixes cases where USER_DIR is set to "." - If the folder is not git repository such as package folder git repo creation in checkpoint used to throw error. Now, we catch that error and just pass on it in case it is not a git repo - Manifest file has been removed as package_data handles its uses - Symlinks to packages that need to be included in mmf wheel have been added in package subfolder so that they are easily includable as per setuptools recommendation - Automatically discovers the package data now - Updates checksum for visual_bert coco - Fix predict command for single GPU Pull Request resolved: https://github.com/facebookresearch/mmf/pull/262 Test Plan: Tested first by publishing on test pypi Reviewed By: vedanuj Differential Revision: D21653287 Pulled By: apsdehal fbshipit-source-id: 06b3b9d818b992b6f015a10d1b0215c9e07f3405 20 May 2020, 22:07:13 UTC
93cd2a7 Amanpreet Singh 16 May 2020, 17:21:46 UTC [enhancement] Speed up build and docs by removing tensorboard dep (#254) Summary: - Tensorboard has been slowing down our building time by huge factor due to grpcio build times - Expose version in the mmf's __init__.py - Now, the warning will only be thrown in case if user tries to use Tensorboard Pull Request resolved: https://github.com/facebookresearch/mmf/pull/254 Test Plan: Tested on CircleCI as well as RTD Reviewed By: vedanuj Differential Revision: D21599427 Pulled By: apsdehal fbshipit-source-id: f7cd2e745f44b9123035ae67ef07e26d19f2c438 16 May 2020, 17:24:17 UTC
d9d1d9a Amanpreet Singh 14 May 2020, 20:30:13 UTC [docs] Add docs for configuration system, fix rtd build (#253) Summary: - Details hierarchy, overrides and other things - Removes fasttext from rtd build to fix build and improve building time Pull Request resolved: https://github.com/facebookresearch/mmf/pull/253 Test Plan: Built the documentation locally and tested the specific branch on RTD as well. Reviewed By: vedanuj Differential Revision: D21567163 Pulled By: apsdehal fbshipit-source-id: 2ad46a8a4cd493c6cb794c079af9f878fe7ac8f9 14 May 2020, 20:31:42 UTC
0035271 Amanpreet Singh 14 May 2020, 03:17:26 UTC [fix] Windows build and add its tests for CircleCI (#252) Summary: - CircleCI now uses `python setup.py install` for installation - Fixes https://github.com/facebookresearch/mmf/issues/250 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/252 Test Plan: Tested on CircleCI Reviewed By: vedanuj Differential Revision: D21564135 Pulled By: apsdehal fbshipit-source-id: 00f276dbe4f1cac3886dcdcda8c2b8682793eccc 14 May 2020, 03:19:00 UTC
ae1689c Vedanuj Goswami 14 May 2020, 00:52:36 UTC [fix] Fix slurm scripts after config changes (#119) Summary: Pull Request resolved: https://github.com/fairinternal/mmf-internal/pull/119 Pull Request resolved: https://github.com/facebookresearch/mmf/pull/251 Fixing slurm scripts after configuration changes. Reviewed By: apsdehal Differential Revision: D21558124 fbshipit-source-id: dad32574bd5ee19d52e17ef6a21b70e392809891 14 May 2020, 00:55:58 UTC
fc9d0f7 Amanpreet Singh 13 May 2020, 17:50:29 UTC [fix] User directory related changes; see summary (#249) Summary: - `get_absolute_path` also checks for user_dir - Fix bug in import_user_module - Adds MMF citation and fixes code block in HM project - Also, use `get_absolute_path` for model_config, dataset_config and user_config Pull Request resolved: https://github.com/facebookresearch/mmf/pull/249 Reviewed By: vedanuj Differential Revision: D21550924 Pulled By: apsdehal fbshipit-source-id: b05c51361edc518fc8006a2b4b93a70649a6c565 13 May 2020, 17:52:07 UTC
b09a1bb Vedanuj Goswami 13 May 2020, 03:49:21 UTC [docs] Hateful Memes challenge tutorial (#247) Summary: Adds a tutorial and submission instructions for Hateful Memes Challenge. Pull Request resolved: https://github.com/facebookresearch/mmf/pull/247 Reviewed By: apsdehal Differential Revision: D21536037 Pulled By: vedanuj fbshipit-source-id: 25869cd3e253b88a853001f74e1e4bee54099c6d 13 May 2020, 03:51:21 UTC
1abcc45 Amanpreet Singh 12 May 2020, 22:41:15 UTC [docs] Add installation docs for MMF (#248) Summary: Pull Request resolved: https://github.com/facebookresearch/mmf/pull/248 Reviewed By: vedanuj Differential Revision: D21526237 Pulled By: apsdehal fbshipit-source-id: 2218bec750114cd0dcd26bd7087c9e49c2f1dc1d 12 May 2020, 22:45:26 UTC
972e7ee Amanpreet Singh 12 May 2020, 22:40:38 UTC [chores,feat] HM Readme along with conversion tools for manual downloads (#246) Summary: - Adds conversion tool for manual downloads needed in HM - Adds README for the project - Add some missing configs under HM - Add command directly to setup for easy accessibility Pull Request resolved: https://github.com/facebookresearch/mmf/pull/246 Reviewed By: vedanuj Differential Revision: D21526040 Pulled By: apsdehal fbshipit-source-id: 696c683ed0c01d1cf6b6af8e650aeead508fa515 12 May 2020, 22:42:55 UTC
9a74f07 Vedanuj Goswami 12 May 2020, 16:06:42 UTC [feature] HM prediction support, new predict cli cmd, support for csv predict file etc (#245) Summary: PR adds the following capabilities : - New `mmf_predict` cli command for pypi. Can also be run as `python tools/predict.py .. ` - Support for saving predictions to a `csv` file in addition to default `json` - New config keys `evaluation.predict` and `evalaution.predict_file_format`. Removes `evalai_inference` - Predictions can be modified from models as well - Add HM predict support Test Plan : ``` mmf_predict config=projects/visual_bert/configs/hateful_memes/defaults.yaml dataset=hateful_memes model=visual_bert evaluation.predict=true evaluation.predict_file_format=csv ``` Pull Request resolved: https://github.com/facebookresearch/mmf/pull/245 Reviewed By: apsdehal Differential Revision: D21520274 Pulled By: vedanuj fbshipit-source-id: da8293d64289d6efe74d70e4857caba629accf1b 12 May 2020, 16:08:42 UTC
5773fe8 Amanpreet Singh 12 May 2020, 05:18:44 UTC [feat,refactor] Resume from zoo, config, class refactor, more robust (#243) Summary: - Directly load from a zoo model with `resume_zoo` option - Optionally, reset optimizers or counts - Use `load_pretrained` to load using `zoo_override` otherwise correct config must be known - `resume_pretrained` added to clarify confusion on loading pretrained mapping - `pretrained_mapping` -> `pretrained_state_mapping` - Complete some pending TODOs in checkpoint class Pull Request resolved: https://github.com/facebookresearch/mmf/pull/243 Test Plan: Yet to be added Also need to update some configs Reviewed By: vedanuj Differential Revision: D21517816 Pulled By: apsdehal fbshipit-source-id: 35eda3a057b12dffcafd30247344ad29afed700b 12 May 2020, 05:20:35 UTC
087a9e5 Vedanuj Goswami 11 May 2020, 08:16:23 UTC [feature] Add hateful memes model zoo (#244) Summary: - Adds pretrained model files for HM to zoo - Adds CC pretrained model from original ViLBERT paper to zoo - Adds a `load_requirements` method to base_model when `zoo_requirements` for the model contains other models for example pretrained models that can be finetuned. See example for `from_coco.yaml` and `from_cc.yaml` in VisualBERT and ViLBERT Test Plan : - Tested all uploaded models by loading them with `.from_pretrained` from `mmf` lib - Tested training HM with configs that require other pretrained models for pretrained weights Pull Request resolved: https://github.com/facebookresearch/mmf/pull/244 Reviewed By: apsdehal Differential Revision: D21499197 Pulled By: vedanuj fbshipit-source-id: 7cdf25d21af6ecdf6f7559e41e809dfd5f666bb9 11 May 2020, 14:42:43 UTC
da5d884 Amanpreet Singh 09 May 2020, 07:35:20 UTC [chores] Remove Pythia logo, update version number, mmf_bert (#242) Summary: - Removes Pythia logo and update documentation as well - Update version number - Also, rename pythia_bert to mmf_bert Pull Request resolved: https://github.com/facebookresearch/mmf/pull/242 Reviewed By: vedanuj Differential Revision: D21490411 Pulled By: apsdehal fbshipit-source-id: c54d7385fafc99ba43928969b72f4fbadeb1e5f5 09 May 2020, 08:24:15 UTC
87c4b83 dependabot[bot] 09 May 2020, 06:13:34 UTC Bump nltk from 3.4.1 to 3.4.5 (#240) Summary: Bumps [nltk](https://github.com/nltk/nltk) from 3.4.1 to 3.4.5. <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/nltk/nltk/blob/develop/ChangeLog">nltk's changelog</a>.</em></p> <blockquote> <p>Version 3.5 2020-04-13</p> <ul> <li>add support for Python 3.8</li> <li>drop support for Python 2</li> <li>create NLTK's own Tokenizer class distinct from the Treebank reference tokeniser</li> <li>update Vader sentiment analyser</li> <li>fix JSON serialization of some PoS taggers</li> <li>minor improvements in grammar.CFG, Vader, pl196x corpus reader, StringTokenizer</li> <li>change implementation <= and >= for FreqDist so they are partial orders</li> <li>make FreqDist iterable</li> <li>correctly handle Penn Treebank trees with a unlabeled branching top node.</li> </ul> <p>Thanks to the following contributors to 3.5: Nicolas Darr, Gerhard Kremer, Liling Tan, Christopher Hench, Alexandre Dias, Hervé Nicol, Pierpaolo Pantone, Bonifacio de Oliveira, Maciej Gawinecki, BLKSerene, hoefling, alvations, pyfisch, srhrshr</p> <p>Version 3.4.5 2019-08-20</p> <ul> <li>Fixed security bug in downloader: Zip slip vulnerability - for the unlikely situation where a user configures their downloader to use a compromised server <a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-14751">https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-14751</a>)</li> </ul> <p>Thanks to the following contributors to 3.4.5: Mike Salvatore</p> <p>Version 3.4.4 2019-07-04</p> <ul> <li>fix bug in plot function (probability.py)</li> <li>add improved PanLex Swadesh corpus reader</li> </ul> <p>Thanks to the following contributors to 3.4.4: Devashish Lal, Liling Tan</p> <p>Version 3.4.3 2019-06-07</p> <ul> <li>add Text.generate()</li> <li>add QuadgramAssocMeasures</li> <li>add SSP to tokenizers</li> <li>return confidence of best tag from AveragedPerceptron</li> <li>make plot methods return Axes objects</li> <li>don't require list arguments to PositiveNaiveBayesClassifier.train</li> <li>fix Tree classes to work with native Python copy library</li> <li>fix inconsistency for NomBank</li> <li>fix random seeding in LanguageModel.generate</li> <li>fix ConditionalFreqDist mutation on tabulate/plot call</li> <li>fix broken links in documentation</li> <li>fix misc Wordnet issues</li> <li>update installation instructions</li> </ul> <p>Thanks to the following contributors to 3.4.3: alvations, Bharat123rox, cifkao, drewmiller, free-variation, henchc irisxzhou, nick-ulle, ppartarr, simonepri, yigitsever, zhaoyanpeng</p> </tr></table> ... (truncated) </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/nltk/nltk/commit/6b0312a41e9403111c9cfb5673947df7416b1f43"><code>6b0312a</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/nltk/nltk/issues/2446">#2446</a> from sildar/3.4.5</li> <li><a href="https://github.com/nltk/nltk/commit/3d5e59707ac0a6928cd54da7db0e935ec0d65b88"><code>3d5e597</code></a> Fix devnull error on python2.7</li> <li><a href="https://github.com/nltk/nltk/commit/acca8d573878e173379fe190d7f14f298b12dac9"><code>acca8d5</code></a> updates for 3.4.5</li> <li><a href="https://github.com/nltk/nltk/commit/083bbf00fcc3b5e944fa5e2708a9a06769af0d5b"><code>083bbf0</code></a> updates for 3.4.5</li> <li><a href="https://github.com/nltk/nltk/commit/f59d7ed8df2e0e957f7f247fe218032abdbe9a10"><code>f59d7ed</code></a> CVE-2019-14751:</li> <li><a href="https://github.com/nltk/nltk/commit/2554ff48feed878ba7e830ada9825196f3eaa86a"><code>2554ff4</code></a> updates for 3.4.4</li> <li><a href="https://github.com/nltk/nltk/commit/fbda91914fee1968cd18a6c3d3ef21871476daee"><code>fbda919</code></a> drop comment about implementation which is no longer accurate, and which did ...</li> <li><a href="https://github.com/nltk/nltk/commit/8bcc98a28d3447ca8eaf3f75ae6fb03165319244"><code>8bcc98a</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/nltk/nltk/issues/2319">#2319</a> from BLaZeKiLL/BLaZeKiLL-polt-bug-fix</li> <li><a href="https://github.com/nltk/nltk/commit/f6a4f38351b1a195fa220776b89c982ff8f55ba3"><code>f6a4f38</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/nltk/nltk/issues/2291">#2291</a> from alvations/better-panlex</li> <li><a href="https://github.com/nltk/nltk/commit/8c75c567d8bacc2df2b7c375130153a8a428455f"><code>8c75c56</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/nltk/nltk/issues/2324">#2324</a> from minho42/Fix-typo</li> <li>Additional commits viewable in <a href="https://github.com/nltk/nltk/compare/3.4.1...3.4.5">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=nltk&package-manager=pip&previous-version=3.4.1&new-version=3.4.5)](https://help.github.com/articles/configuring-automated-security-fixes) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `dependabot rebase` will rebase this PR - `dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `dependabot merge` will merge this PR after your CI passes on it - `dependabot squash and merge` will squash and merge this PR after your CI passes on it - `dependabot cancel merge` will cancel a previously requested merge and block automerging - `dependabot reopen` will reopen this PR if it is closed - `dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) - `dependabot use these labels` will set the current labels as the default for future PRs for this repo and language - `dependabot use these reviewers` will set the current reviewers as the default for future PRs for this repo and language - `dependabot use these assignees` will set the current assignees as the default for future PRs for this repo and language - `dependabot use this milestone` will set the current milestone as the default for future PRs for this repo and language You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/facebookresearch/mmf/network/alerts). </details> Pull Request resolved: https://github.com/facebookresearch/mmf/pull/240 Reviewed By: apsdehal Differential Revision: D21489985 Pulled By: vedanuj fbshipit-source-id: ceda20960fb6e723baa5295a47f23b4d56308569 09 May 2020, 06:25:36 UTC
355f61f vedanuj 09 May 2020, 04:45:15 UTC [fix] FB Shipit Sync fbshipit-source-id: ebe8266069f5c2d1e28b588697b5f8f3587ed2f1 09 May 2020, 04:45:15 UTC
4517e13 Amanpreet Singh 08 May 2020, 21:37:12 UTC [feature] CLI commands for PyPI package along with user_dir option (#104) Summary: - Allows users to specify their own directory as a one step forward towards MMF as a lib - mmf_run commmand to run mmf training from virtual anywhere - Add functions for easy imports on user end - Fixes test_results upload issue on circleci - Address some comments from previous PR - User dir can also be specified via MMF_USER_DIR Pull Request resolved: https://github.com/fairinternal/mmf-internal/pull/104 Test Plan: Install with `python setup.py develop` and use mmf_train instead of `python -u tools/run.py` to run all of your commands now. Reviewed By: vedanuj Differential Revision: D21173056 Pulled By: apsdehal fbshipit-source-id: de24b990e5c18e478f413a7c3f6b23b6abce6949 08 May 2020, 22:07:19 UTC
95340d1 Vedanuj Goswami 08 May 2020, 07:33:04 UTC [feature] Config updates for HM, Unimodal image with feature changes (#118) Summary: - Config updates for Hateful Memes - Change unimodal image to mean output features in spatial dimension before feeding to classifier. Pull Request resolved: https://github.com/fairinternal/mmf-internal/pull/118 Reviewed By: apsdehal Differential Revision: D21473057 Pulled By: vedanuj fbshipit-source-id: 47f1d47816d40b12847afa370ce71db4d8c3a13d 08 May 2020, 22:07:19 UTC
c98800a Amanpreet Singh 08 May 2020, 06:34:45 UTC [fix] Support for torch.distributed.launch (#110) Summary: - Some people still will use torch.distributed.launch for distributed setup when they won't have slurm or some other launcher. - This PR aims to fix the support for it Pull Request resolved: https://github.com/fairinternal/pythia-internal/pull/110 Test Plan: - Tested on devfair with following command ``` OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=2 tools/run.py config="projects/pythia/configs/vqa2/defaults.yaml" model=pythia dataset=vqa2 training.num_workers=0 ``` Reviewed By: vedanuj Differential Revision: D21447059 Pulled By: apsdehal fbshipit-source-id: 21df45152f7acbc4ed52c9116529ab480208c722 08 May 2020, 22:07:19 UTC
d981094 Amanpreet Singh 08 May 2020, 01:40:34 UTC [chores] Updates to docs/readme regarding MMF (#117) Summary: - Adding banners of top of documentation to clarify about the outdated stuff. - Explicitly mentions to download v0.3 for the meanwhile - Adds redirect for learnpythia to mmf documentation Pull Request resolved: https://github.com/fairinternal/mmf-internal/pull/117 Reviewed By: vedanuj Differential Revision: D21450908 Pulled By: apsdehal fbshipit-source-id: 3370bbc53bb5012383f193447307fd3637258305 08 May 2020, 22:07:19 UTC
ef04cc2 Amanpreet Singh 08 May 2020, 01:38:52 UTC [feature] Hateful Memes Dataset (#115) Summary: - Dataset zoo for HM - All of model configurations - Image processors have been added - Properly use MMFDataset for the HM dataset - Some bug fixes in the models Pull Request resolved: https://github.com/fairinternal/mmf-internal/pull/115 Test Plan: All of the models present in the paper are tested to be working Same as the previous commit you can set the data dir to my data dir and test with it. Reviewed By: vedanuj Differential Revision: D21447066 Pulled By: apsdehal fbshipit-source-id: 8890503e95075ebe33eac02a3be540ff980c6b6b 08 May 2020, 22:07:19 UTC
back to top