summaryrefslogtreecommitdiff
path: root/Code/update_network.py
AgeCommit message (Collapse)Author
2024-08-10[update_network.py] Do not generation json files for gene expression if not ↵Hui Lan
do webapp
2024-08-09[update_network.py] Simplify codeHui Lan
2024-08-07Fix error occurred while running update_network.pyHui Lan
2024-08-07[update_network.py] Rename FILE_TIMESTAMP to TIMESTAMP_FILEHui Lan
2024-08-07Review update_network.pyHui Lan
2024-08-07Put the definition of make_paths() in utils.py because multiple places use itHui Lan
2024-08-06update_network.py: delete the 'merge edge' stuff because this is the job of ↵Hui Lan
update_network_by_force.py
2024-08-05Update write_log_file() so that it put the most recent message on the top; ↵Hui Lan
remove duplicate write_log_file()
2022-11-20update_network.py: no longer need to redirect to fileHui Lan
2022-10-09Shorten config variable name, remove 'PARAMETER_FOR_'Hui Lan
2021-02-09update_network.py: code review.Hui Lan
2021-02-06Move edge files in edge_pool to /disk1/edge_pool to save space in the workspace.Hui Lan
2020-10-21update_network.py: make TPM.txt.Hui Lan
2020-02-06backup_files.py: fix misspellingHui Lan
2020-01-21merge_edges.py: write all edge information to an SQLite database file called ↵Hui Lan
edges.sqlite When I saved a static html page for each edge (e.g., http://118.25.96.118/static/edges/AT1G20910_AT1G30100_0.html), it took 5GB disk space for saving 1 million html pages. Not very disk space efficient. An alternative is to save all edge information in a database table (i.e., edge), and query this database table for a particular edge. The database file edges.sqlite takes less than 200MB for 1 million edges, requiring 10 times smaller space than the static approach. The reason is that we do not have a lot of HTML tags in the database. Quite happy about that, though it seems that filling a database is a bit slower (2 hours??? for 1 million rows). Also updated two files that were affected: update_network.py and update_network_by_force.py. Now instead of copying 1 million static html page to the Webapp, I just need to copy edges.sqlite to static/edges/. Faster. In the Webapp, I updated start_webapp.py and added a file templates/edge.html for handling dynamic page generation. -Hui
2019-12-07create backup_files.py for backing up filesHui Lan
Define a function copy_and_backup_file(src_file, dest_dir) to do backup and compression work. The function copy_and_backup_file is used in update_network_by_force.py. -Hui
2019-12-04brain: add python and R code to local repository.Hui Lan