summaryrefslogtreecommitdiff
path: root/Code/update_network.py
AgeCommit message (Collapse)Author
2022-10-09Shorten config variable name, remove 'PARAMETER_FOR_'Hui Lan
2021-02-09update_network.py: code review.Hui Lan
2021-02-06Move edge files in edge_pool to /disk1/edge_pool to save space in the workspace.Hui Lan
2020-10-21update_network.py: make TPM.txt.Hui Lan
2020-02-06backup_files.py: fix misspellingHui Lan
2020-01-21merge_edges.py: write all edge information to an SQLite database file called ↵Hui Lan
edges.sqlite When I saved a static html page for each edge (e.g., http://118.25.96.118/static/edges/AT1G20910_AT1G30100_0.html), it took 5GB disk space for saving 1 million html pages. Not very disk space efficient. An alternative is to save all edge information in a database table (i.e., edge), and query this database table for a particular edge. The database file edges.sqlite takes less than 200MB for 1 million edges, requiring 10 times smaller space than the static approach. The reason is that we do not have a lot of HTML tags in the database. Quite happy about that, though it seems that filling a database is a bit slower (2 hours??? for 1 million rows). Also updated two files that were affected: update_network.py and update_network_by_force.py. Now instead of copying 1 million static html page to the Webapp, I just need to copy edges.sqlite to static/edges/. Faster. In the Webapp, I updated start_webapp.py and added a file templates/edge.html for handling dynamic page generation. -Hui
2019-12-07create backup_files.py for backing up filesHui Lan
Define a function copy_and_backup_file(src_file, dest_dir) to do backup and compression work. The function copy_and_backup_file is used in update_network_by_force.py. -Hui
2019-12-04brain: add python and R code to local repository.Hui Lan