From Facebook

https://opensource.facebook.com/

Hydra

Links
https://github.com/facebookresearch/hydra
https://hydra.cc/

Powered by Omegaconf.

1
2
3
4
5
6
Hydra
    [framework]

    Elegantly configure complex applications.

    https://hydra.cc

Basic example

Configuration file
config.yaml
1
2
3
4
db:
  driver: mysql
  user: omry
  pass: secret
Python file
my_app.py
1
2
3
4
5
6
7
8
9
import hydra
from omegaconf import DictConfig

@hydra.main(config_path="config.yaml")
def my_app(cfg : DictConfig) -> None:
    print(cfg.pretty())

if __name__ == "__main__":
    my_app()

config.yaml is loaded automatically when you run your application.

1
python my_app.py
1
2
3
4
db:
  driver: mysql
  pass: secret
  user: omry

You can override values in the loaded config from the command line:

1
python my_app.py db.user=root db.pass=1234
1
2
3
4
db:
  driver: mysql
  user: root
  pass: 1234

PyRobot

https://github.com/facebookresearch/pyrobot

3rd Party

LGTM

1
2
3
4
5
6
7
8
LGTM
    https://lgtm.com/

    Provides "Continuous security analysis".

    A code analysis platform for finding
    zero-days and preventing critical
    vulnerabilities

CodeQL by GitHub and Semmle // Bodacious Blog

OmegaConf

1
2
3
4
5
6
7
OmegaConf
    A hierarchical configuration system, with
    support for merging configurations from
    multiple sources (YAML config files,
    dataclasses/objects and CLI arguments)
    providing a consistent API regardless of
    how the configuration was created.

https://github.com/omry/omegaconf

Apache

Presto

https://prestodb.io/

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
Presto
    An open source distributed SQL query
    engine for running interactive analytic
    queries against data sources of all sizes
    ranging from gigabytes to petabytes.

    Presto was designed and written from the
    ground up for interactive analytics and
    approaches the speed of commercial data
    warehouses while scaling to the size of
    organizations like Facebook.

    Presto allows querying data where it
    lives, including Hive, Cassandra,
    relational databases or even proprietary
    data stores.

    A single Presto query can combine data
    from multiple sources, allowing for
    analytics across your entire organization.

    Presto is targeted at analysts who expect
    response times ranging from sub-second to
    minutes.

    Presto breaks the false choice between
    having fast analytics using an expensive
    commercial solution or using a slow "free"
    solution that requires excessive hardware.