summaryrefslogtreecommitdiff
path: root/Code
AgeCommit message (Collapse)Author
2020-01-21merge_edges.py: write all edge information to an SQLite database file called ↵Hui Lan
edges.sqlite When I saved a static html page for each edge (e.g., http://118.25.96.118/static/edges/AT1G20910_AT1G30100_0.html), it took 5GB disk space for saving 1 million html pages. Not very disk space efficient. An alternative is to save all edge information in a database table (i.e., edge), and query this database table for a particular edge. The database file edges.sqlite takes less than 200MB for 1 million edges, requiring 10 times smaller space than the static approach. The reason is that we do not have a lot of HTML tags in the database. Quite happy about that, though it seems that filling a database is a bit slower (2 hours??? for 1 million rows). Also updated two files that were affected: update_network.py and update_network_by_force.py. Now instead of copying 1 million static html page to the Webapp, I just need to copy edges.sqlite to static/edges/. Faster. In the Webapp, I updated start_webapp.py and added a file templates/edge.html for handling dynamic page generation. -Hui
2020-01-18download_and_map.py: write "no enough space" warning message to network log fileHui Lan
If there is no enough space left in the disk, download_and_map.py will refuse to download any data. This can be quite mysterious for a maintainer. So, write the reason to the network log file. The reason is something like: "[download_and_map.py] home directory does not have enough space (only 13 G available)." -Hui
2019-12-26merge_edges.py: save memory by removing the dictionary variable duniqHui Lan
The purpose of duniq is to avoid duplicated edge lines. Now, just make sure we don't insert the same tuple. -Hui
2019-12-12update_network_by_force.py: summarize the association strength in the edge fileHui Lan
It would be interesting to see how edges' association strengths change over time, as time is an input variable for the function that computes the association strength.
2019-12-07create backup_files.py for backing up filesHui Lan
Define a function copy_and_backup_file(src_file, dest_dir) to do backup and compression work. The function copy_and_backup_file is used in update_network_by_force.py. -Hui
2019-12-06draw_subnetwork.py: add a known network (G0) from the thermomorphogenesis paper.Hui Lan
Fixed a bug. Now I close figure (plt.close()) before creating a new one, to avoid that the current figure is drawn on top of the old one. -Hui
2019-12-05draw_subnetwork.py for generating a subnetwork consisting of genes that ↵Hui Lan
might be responsible for thermomorphogenesis Use networkx and matplotlib. Reference: Quint et al. (2016) Molecular and genetic control of plant thermomorphogenesis. Nature Plants.
2019-12-05add count_AGI_in_cDNA.py for counting number of unique genes in a cdna file.Hui Lan
2019-12-04merge_edges.py: run dos2unix on merge_edges.py to remove ^M characters.Hui Lan
2019-12-04merge_edges.py: clean up source code by removing commented lines and editing ↵Hui Lan
the head comments.
2019-12-04brain: add python and R code to local repository.Hui Lan