Description
Open data -- data that is free for use, reuse, and redistribution -- is an intellectual treasure-trove that has given rise to many unexpected and often fruitful applications. In this course, students will:
1) learn how to access, visualize, clean, interpret, and share data, especially open data, using Python, Python-based libraries, and supplementary computational frameworks
2) understand the theoretical underpinnings of open data and their connections to implementations in the physical and life sciences, government, social sciences, and journalism.
Working with Open Data (WwOD) is a technical course with a strong focus on the social-political context and domains of application of open data.
Prerequisite
Info 90 (Programming for Computing Applications) or equivalent background with Python.
1) learn how to access, visualize, clean, interpret, and share data, especially open data, using Python, Python-based libraries, and supplementary computational frameworks
2) understand the theoretical underpinnings of open data and their connections to implementations in the physical and life sciences, government, social sciences, and journalism.
Working with Open Data (WwOD) is a technical course with a strong focus on the social-political context and domains of application of open data.
Prerequisite
Info 90 (Programming for Computing Applications) or equivalent background with Python.
General Information
Lecture Location
210, South Hall
Announcements
Room Change: today's meeting is in 107 South Hall instead of 205 South Hall (3-4pm)
5/15/13 10:39 AM
For those of you planning to come to the meeting, note the change to 107 South Hall.
Meeting with Fernando Perez and Min Ragan-Kelley Wednesday May 15 3-4pm in 205 South Hall
5/09/13 3:18 PM
We have a time and place set for the follow up meeting with Fernando Perez and Min Ragan-Kelley: Wednesday, May 15 3-4pm in 205 South Hall.
Just to be clear -- participation in this meeting is not a requirement of the course. It will be just a wonderful opportunity to learn more about IPython with two of the most knowledgeable people around about IPython!
Just to be clear -- participation in this meeting is not a requirement of the course. It will be just a wonderful opportunity to learn more about IPython with two of the most knowledgeable people around about IPython!
Followup with Fernando Perez
5/09/13 10:13 AM
Hi everyone,
I'm very happy with the work that you guys did on your projects. Fernando Perez was also very impressed wants to work with us to highlight the work we've done to the larger community. I'm gathering up pointers to your work, starting with what's contained in https://docs.google.com/a/berkeley.edu/document/d/1ZMZcai8k5YA-_re_ZWhdQFwTk0xmTbQP0UIaDlb72lE/edit#heading=h.fcxp78qp0qz . Some of you have work in private repositories; if you'd like to make your work public, do so and include a reference in your project section under project abstracts. I'll take what I have by next Wednesday 5/15 at 9am.
Also, Fernando and his group would like to meet with us to show us tips on how we could take our work to the next level in the IPython notebook context. We're tentatively looking at setting up a 1-2 hour meeting the afternoon of Wednesday May 15. Let me know if any of you would like to participate!
-Raymond
I'm very happy with the work that you guys did on your projects. Fernando Perez was also very impressed wants to work with us to highlight the work we've done to the larger community. I'm gathering up pointers to your work, starting with what's contained in https://docs.google.com/a/berkeley.edu/document/d/1ZMZcai8k5YA-_re_ZWhdQFwTk0xmTbQP0UIaDlb72lE/edit#heading=h.fcxp78qp0qz . Some of you have work in private repositories; if you'd like to make your work public, do so and include a reference in your project section under project abstracts. I'll take what I have by next Wednesday 5/15 at 9am.
Also, Fernando and his group would like to meet with us to show us tips on how we could take our work to the next level in the IPython notebook context. We're tentatively looking at setting up a 1-2 hour meeting the afternoon of Wednesday May 15. Let me know if any of you would like to participate!
-Raymond
Some clarifications on what I'm looking for in presentations and final projects
4/29/13 1:19 PM
Although I've talked about what I'm looking for in class, it seems like there is still some confusion about what we have happening this week and next and what I'm expecting.
Tomorrow and Thursday, we have in-class presentations. Next week on Tuesday May 7, we have an open house/poster sessions. So you'll be presenting before you necessarily have everything done.
Here's what I'm looking for in terms of the in class presentations:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(2)
Here's a schedule for the presentations:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(3)
Here are framing questions we'll use for the Q&A time for each project:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(4)
Here's what I'm looking for in the final project notebook:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(5)
Ideally, I'd like to have the notebooks in more or less final form by Monday, May 6 at noon
(http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day25.html#(4)) -- but you can keep editing it until the beginning of our open house on May 7.
Let me know if you have any questions.
-Raymond
Tomorrow and Thursday, we have in-class presentations. Next week on Tuesday May 7, we have an open house/poster sessions. So you'll be presenting before you necessarily have everything done.
Here's what I'm looking for in terms of the in class presentations:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(2)
Here's a schedule for the presentations:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(3)
Here are framing questions we'll use for the Q&A time for each project:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(4)
Here's what I'm looking for in the final project notebook:
http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day27.html#(5)
Ideally, I'd like to have the notebooks in more or less final form by Monday, May 6 at noon
(http://htmlpreview.github.io/?https://github.com/rdhyee/working-open-data/blob/master/lectures/day25.html#(4)) -- but you can keep editing it until the beginning of our open house on May 7.
Let me know if you have any questions.
-Raymond
Still waiting for 2 project abstracts and also I'm looking for URL to IPython notebook in abstracts
4/26/13 4:09 PM
Hi everyone,
Thanks for everyone who has put up abstracts for their projects. I'm still waiting for 2 project abstracts.
Also: I didn't make super-clear that in the abstracts that I'm looking also for a URL that points to where people will be able to find your completed IPython notebook. Please get your notebooks in (more or less) final presentable form by Monday May 6, 2013 noon. (You can start with a placeholder notebook with your abstract.)
I updated this request in the slides....
Once I get all the abstracts together, I'll put out an invitation that we can use.
Thanks for everyone who has put up abstracts for their projects. I'm still waiting for 2 project abstracts.
Also: I didn't make super-clear that in the abstracts that I'm looking also for a URL that points to where people will be able to find your completed IPython notebook. Please get your notebooks in (more or less) final presentable form by Monday May 6, 2013 noon. (You can start with a placeholder notebook with your abstract.)
I updated this request in the slides....
Once I get all the abstracts together, I'll put out an invitation that we can use.
How to make picloud notebooks available publicly
4/21/13 4:42 PM
If you want to make a PiCloud notebook visible to me, you need to make
it public. Go to
https://www.picloud.com/accounts/bucket/#/?curr_loc=notebook/
and click on "make public" for the notebook in question. Then you can
copy the resultant link and feed that link to nbviewer.ipython.org.
For example,
one of my notebooks is available from
https://pi-user-buckets.s3.amazonaws.com/bKkRFJzc0CNIRAkhn6P50MHLmNEqry24er6MOcOI/notebook/Day_21_CommonCrawl_Starter.ipynb
and the corresponding nbviewer link is:
http://nbviewer.ipython.org/urls/pi-user-buckets.s3.amazonaws.com/bKkRFJzc0CNIRAkhn6P50MHLmNEqry24er6MOcOI/notebook/Day_21_CommonCrawl_Starter.ipynb
it public. Go to
https://www.picloud.com/accounts/bucket/#/?curr_loc=notebook/
and click on "make public" for the notebook in question. Then you can
copy the resultant link and feed that link to nbviewer.ipython.org.
For example,
one of my notebooks is available from
https://pi-user-buckets.s3.amazonaws.com/bKkRFJzc0CNIRAkhn6P50MHLmNEqry24er6MOcOI/notebook/Day_21_CommonCrawl_Starter.ipynb
and the corresponding nbviewer link is:
http://nbviewer.ipython.org/urls/pi-user-buckets.s3.amazonaws.com/bKkRFJzc0CNIRAkhn6P50MHLmNEqry24er6MOcOI/notebook/Day_21_CommonCrawl_Starter.ipynb
Talk by Fernando Perez has been added to class homepage under Resources
4/17/13 8:35 PM
The teaching staff has posted a new general resource.
Title: Talk by Fernando Perez
https://docs.google.com/file/d/0B-NkkRVaYqkUcGE2Q0tYSmlKdXM/edit?usp=sharing
You can view it on the course page: https://piazza.com/berkeley/spring2013/info290t/resources
#class-resources #homework
Title: Talk by Fernando Perez
https://docs.google.com/file/d/0B-NkkRVaYqkUcGE2Q0tYSmlKdXM/edit?usp=sharing
You can view it on the course page: https://piazza.com/berkeley/spring2013/info290t/resources
#class-resources #homework
I've written up what I'm looking for in the homework for Thursday
Name | Office Hours | |
---|---|---|
Raymond Yee | When? Where? | |
Jacob Portnoff | When? Where? |
Homework
Homework
Due Date
Apr 26, 2013
Apr 23, 2013
Apr 18, 2013
Apr 15, 2013
Mar 15, 2013
Mar 1, 2013
Feb 22, 2013
Feb 8, 2013
Jan 24, 2013
Lecture Notes
Lecture Notes
Lecture Date
May 7, 2013
May 2, 2013
Apr 30, 2013
Apr 23, 2013
Apr 18, 2013
Apr 16, 2013
Apr 9, 2013
Apr 4, 2013
Mar 21, 2013
Mar 19, 2013
Mar 14, 2013
Mar 7, 2013
Feb 28, 2013
Feb 26, 2013
Feb 21, 2013
Feb 14, 2013
Feb 12, 2013
Jan 31, 2013
Jan 29, 2013
Jan 22, 2013