Age | Commit message (Collapse) | Author | |
---|---|---|---|
2024-08-09 | [update_network.py] Simplify code | Hui Lan | |
2024-08-07 | Fix error occurred while running update_network.py | Hui Lan | |
2024-08-07 | [update_network.py] Rename FILE_TIMESTAMP to TIMESTAMP_FILE | Hui Lan | |
2024-08-07 | Review update_network.py | Hui Lan | |
2024-08-07 | Put the definition of make_paths() in utils.py because multiple places use it | Hui Lan | |
2024-08-06 | update_network.py: delete the 'merge edge' stuff because this is the job of ↵ | Hui Lan | |
update_network_by_force.py | |||
2024-08-05 | Update write_log_file() so that it put the most recent message on the top; ↵ | Hui Lan | |
remove duplicate write_log_file() | |||
2022-11-20 | update_network.py: no longer need to redirect to file | Hui Lan | |
2022-10-09 | Shorten config variable name, remove 'PARAMETER_FOR_' | Hui Lan | |
2021-02-09 | update_network.py: code review. | Hui Lan | |
2021-02-06 | Move edge files in edge_pool to /disk1/edge_pool to save space in the workspace. | Hui Lan | |
2020-10-21 | update_network.py: make TPM.txt. | Hui Lan | |
2020-02-06 | backup_files.py: fix misspelling | Hui Lan | |
2020-01-21 | merge_edges.py: write all edge information to an SQLite database file called ↵ | Hui Lan | |
edges.sqlite When I saved a static html page for each edge (e.g., http://118.25.96.118/static/edges/AT1G20910_AT1G30100_0.html), it took 5GB disk space for saving 1 million html pages. Not very disk space efficient. An alternative is to save all edge information in a database table (i.e., edge), and query this database table for a particular edge. The database file edges.sqlite takes less than 200MB for 1 million edges, requiring 10 times smaller space than the static approach. The reason is that we do not have a lot of HTML tags in the database. Quite happy about that, though it seems that filling a database is a bit slower (2 hours??? for 1 million rows). Also updated two files that were affected: update_network.py and update_network_by_force.py. Now instead of copying 1 million static html page to the Webapp, I just need to copy edges.sqlite to static/edges/. Faster. In the Webapp, I updated start_webapp.py and added a file templates/edge.html for handling dynamic page generation. -Hui | |||
2019-12-07 | create backup_files.py for backing up files | Hui Lan | |
Define a function copy_and_backup_file(src_file, dest_dir) to do backup and compression work. The function copy_and_backup_file is used in update_network_by_force.py. -Hui | |||
2019-12-04 | brain: add python and R code to local repository. | Hui Lan | |