You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: 01.01-goingdigitalintro.Rmd
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -14,6 +14,6 @@ Hanna Marie Pageau succintly captured these issues, when over a series of tweets
14
14
15
15
An important aspect of digital archaeology that differentiates it from the use of computing power to answer archaeological questions is the question of _purpose_. In this section, we take up this issue in terms of _teaching_ digital approaches. We progress by suggesting that teaching digital archaeology is akin to work at the intersection of art and public archaeology and digital humanities - it is playful, experiential and deformative. We provide you the necessary basics for setting up your own digital archaeological practice. Entrance into the world of digital archaeology requires organizational ability and facility with versioning files. It is allied with the practice of open notebook science, and it attempts to future-proof by using the simplest file formats and avoiding proprietary software where possible. These are the basics on which the rest of this textbook in digital archaeological practice is founded.
16
16
17
-
### Further Reading
17
+
### Further Reading {-}
18
18
19
-
For a comprehensive discussion on 'theorising the digital' in digital archaeology, see @taylor_and_perry_2018 ([full text on ResearchGate](https://www.researchgate.net/publication/329642181_Theorising_the_Digital_A_Call_to_Action_for_the_Archaeological_Community). For a discussion on different kinds of digital archaeology, see @cook_compton_2018.
19
+
For a comprehensive discussion on 'theorising the digital' in digital archaeology, see @taylor_and_perry_2018 ([full text on ResearchGate](https://www.researchgate.net/publication/329642181_Theorising_the_Digital_A_Call_to_Action_for_the_Archaeological_Community)). For a discussion on different kinds of digital archaeology, see @cook_compton_2018.
Copy file name to clipboardExpand all lines: 01.4-opennotebookresearch.Rmd
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -70,7 +70,7 @@ Your help query can also go into your open notebook. In this way, your open note
70
70
71
71
### Discussion
72
72
73
-
Questions for discussion:
73
+
Questions for Discussion:
74
74
75
75
1. Search the archaeological literature (via [jstor](http://jstor.org) or [Google Scholar](https://scholar.google.ca/)) for examples of open notebook science 'in the wild'. Are you finding anything, and if so, where? Do there seem to be impediments *from the journals* regarding this practice?
76
76
2. What excites you about the possibilities of open notebook archaeology? What are the advantages?
Copy file name to clipboardExpand all lines: 02.1-designing-data-collection.rmd
+6-4Lines changed: 6 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -9,6 +9,7 @@ In teaching, there is a concept called 'backwards design', where you design your
9
9
And so, we will begin this section on data collection by thinking through where the _things_ are going to go.
10
10
11
11
12
+
12
13
*The design of data collection informs the structure of the database, and the other way around.*
13
14
14
15
Choices about which fields of data to collect and how to collect them will influence the "shape" of your database, and have consequences for how much cleaning and restructuring you might need to do later.
@@ -25,16 +26,18 @@ While this is, after all, the *Open* ***Digital*** *Archaeology Textbook Environ
25
26
Much of the following discussion assumes that you are planning for archaeological field data collection. But in digital archaeology and heritage, that might not be the case.
26
27
27
28
*Paper to digital*
29
+
28
30
Sometimes the most straightforward way to collect data in the field is to write it on paper. Paper forms can't run out of batteries. Data loss and integrity issues are still real, but massive data loss may be less of a threat when working with paper, depending on backup mechanisms.
29
31
30
32
It's usually a good choice to mirror the format of the destination database on the input form.
31
33
32
34
*Born digital*
35
+
33
36
Collecting your data digitally holds significant advantages. If you've settled on the structure of your destination database, digital data collection can seamlessly integrate information, eliminating extra steps and reducing opportunities for transcription errors.
34
37
35
38
The landscape for mobile data collection in archaeology has flourished in recent years. Archaeologists now have access to a broad spectrum of data collection options, from off-the-shelf mobile data collection applications custom designed to meet to meet the needs of specific projects and organizations to assembling a suite of free, open source tools as needed.
36
39
37
-
The trick in designing digital data collection is to set limits without over-constraining. Typing data into fields in an Excel spreadsheet is digital data collection, sure, but setting up controls to standardize data entry with spreadsheet functions can be complicated and fragile.<sup>[1](#myfootnote1)</sup>
40
+
The trick in designing digital data collection is to set limits without over-constraining. Typing data into fields in an Excel spreadsheet is digital data collection, sure, but setting up controls to standardize data entry with spreadsheet functions can be complicated and fragile. (If you find yourself engineering a complicated spreadsheet with dependent picklists and formulas for relationships, this may be a sign that you're using the wrong tool.)
38
41
39
42
Whether you're designing data collection on paper or on a device, give yourself time to test it out. A dry run with real (or close to real) data can illuminate pain points for data collection now and analysis later. You might find that, for your project's specific needs, well-designed paper data collection will do the trick. Or you might combine paper and digital approaches. There's no right answer or perfect software for every project.
40
43
@@ -47,17 +50,18 @@ When we talk about data structure, we're often referring to *databases*, whether
47
50
[Earlier in this section we briefly discussed digital preservation](/book/making-data-useful.html). We covered the basics of what it takes for stable, reusable data, but where will it live? Let's talk about *repositories.* A digital repository can be short-term or long-term.
48
51
49
52
Questions to consider:
53
+
50
54
+ If you're planning to curate your own digital materials and hope to keep them safe for a long time, are you prepared to do regular checks and maintenance?
51
55
+ What do you want to save? It might not be *everything*.
52
56
53
57
If you're looking toward an outside repository:
58
+
54
59
+ Does it have room for your data? Is your research or data within the scope of mission for that repository?
55
60
+ Does the repository have special requirements for format or preparation?
56
61
+ Does the repository charge a fee to deposit material? Have you built it into your budget?
57
62
+ Does the repository itself have a plan for long-term sustainability? What happens to the data if its host organization is dissolved?
58
63
+ Does the repository have plans for migrating and maintaining your files?
59
64
60
-
61
65
**Some Existing Repositories for Archaeological Data and/or Digital Projects**
62
66
Each option below meets differing needs. The world of digital repositories is vast and dynamic and this is just a sampling of possibilities.
63
67
@@ -93,5 +97,3 @@ It is important to understand that just because your information is archived saf
93
97
### Further Reading
94
98
For a great workflow using KoBoToolbox, QGIS, PostGIS, and LibreOffice Base (all free and open source tools), see [this overview from Ben Carter](http://benjaminpcarter.com/digital-data-collection/tools/).
95
99
<!-- add more please! -->
96
-
97
-
<aname="myfootnote1">1</a>: If you find yourself engineering a complicated spreadsheet with dependent picklists and formulas for relationships, this may be a sign that you're using the wrong tool.
Copy file name to clipboardExpand all lines: 02.2-databases.rmd
+1-2Lines changed: 1 addition & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -34,7 +34,7 @@ Excel specifically is incredibly hard to version control, or to trace the histor
34
34
**Comma or Tab-separated text files (.csv, .tsv, .txt)**
35
35
36
36
*Pros*
37
-
These kinds of text files are some of the simplest ways to store data, and thus also some of the most durable. You can open them as tables in a spreadsheet program like Excel or Google Sheets, but all the information is still readable in a plain text editor. Since there's not much complicated underlying structure, these types of plain text files are very easy to *version control,* or retain and view information about changes to a file over its life span. In most cases, if you need to work in and save spreadsheet data, choose one of these formats over Excel or other formats.[2](#foot2)</sup>
37
+
These kinds of text files are some of the simplest ways to store data, and thus also some of the most durable. You can open them as tables in a spreadsheet program like Excel or Google Sheets, but all the information is still readable in a plain text editor. Since there's not much complicated underlying structure, these types of plain text files are very easy to *version control,* or retain and view information about changes to a file over its life span. In most cases, if you need to work in and save spreadsheet data, choose one of these formats over Excel or other formats. (If you have dates in your CSV or TSV file and you save using Excel, it may still try to monkey around with the formatting. Make sure your date columns are formatted to Text.)
38
38
39
39
*Cons*
40
40
To some degree, you might have less control of formatting when using plain text files (but this may be a feature and not a bug.)
@@ -198,7 +198,6 @@ An entry level graph database is [Neo4J](http://neo4j.com). An advanced level gr
198
198
[A Gentle Introduction to SQL](https://mybinder.org/v2/gh/o-date/sqlite/master?filepath=intro%20to%20sql.ipynb)
199
199
200
200
201
-
<aname="foot2">2</a>: Excel, again. If you have dates in your CSV or TSV file and you save using Excel, it may still try to monkey around with the formatting. Make sure your date columns are formatted to Text.
Copy file name to clipboardExpand all lines: 04.1-3d-photogrammetry.rmd
+3-1Lines changed: 3 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,7 @@
1
1
## 3D Photogrammetry
2
2
3
+
<divclass = rmdnote> _[Launch the Photogrammetry notebook in Google Collab](https://colab.research.google.com/github/o-date/photogrammetry/blob/master/Meshroom_%2B_GPU_for_Photogrammetry.ipynb) and follow the directions; this notebook can be connected to your Google Drive._ </div>
4
+
3
5
In recent years, faster and more powerful computers have made it feasible to do complex 3d model building by extracting points of overlap in multiple photographs, then extrapolating from the camera metadata embedded in those images the distance from the points to the camera's image sensor.This information allows the reconstruction of where those points were _in space_ relative to the camera. Thus astonishingly good 3d models can be created at rather low cost.
4
6
5
7
Laser scanning, on the other hand, involves shooting rays of light onto an object (or space) and counting the time it takes for the light to return to the scanner. Laser scanners are able therefore to take detailed micro-millimetre scans of an object's surface and texture. For some archaeological purposes, laser scanning is to be preferred. For other purposes, 3d photogrammetry or 'structure from motion' (sfm) is entirely appropriate, and the level of resolution good enough
@@ -35,7 +37,7 @@ Verdiani, G. (2015). Bringing Impossible Places to the Public: Three Ideas for R
35
37
36
38
### exercises
37
39
38
-
While there are command-line applications (like [VSFM](http://ccwu.me/vsfm/)) for photogrammetry, running such things from a Jupyter notebook does not work very well. VSFM *can* be installed in something like DHBox (but it's not for the faint-of-heart, see eg [this](http://www.10flow.com/2012/08/15/building-visualsfm-on-ubuntu-12-04-precise-pangolin-desktop-64-bit/)). Roman Hiestand built a graphical user interface around a series of open-source modules that, when combined in a workflow, enables you to experiment with photogrammetry. With a bit of hacking, we can also make it work with photographs taken from smartphone or tablet.
40
+
While there are command-line applications (like [VSFM](http://ccwu.me/vsfm/)) for photogrammetry, installing is not for the faint of heart (see eg.[this for Ubuntu](http://www.10flow.com/2012/08/15/building-visualsfm-on-ubuntu-12-04-precise-pangolin-desktop-64-bit/)). The notebook linked at the start of this chapter uses [Meshroom from AliceVision](https://alicevision.org/) as a command-line interface to a Google-provided GPU, and is worth exploring. But if you would like to try something on your own machine, Roman Hiestand built a graphical user interface around a series of open-source modules that, when combined in a workflow, enables you to experiment with photogrammetry. With a bit of hacking, we can also make it work with photographs taken from smartphone or tablet.
39
41
40
42
Download and install the relevant version of [Regard3d](http://www.regard3d.org/) for your operating system.
- a local network generated and managed by a wireless router
75
76
- a Raspberri Pi mini-computer upon which the database will reside and be served to other devices across the network
76
77
- the software configured to host the database and ensure that the data is secured and backed up
@@ -597,6 +598,5 @@ Please refer to [this resource](https://www.raspberrypi.org/magpi/samba-file-ser
597
598
### Discussion
598
599
These guides and workflows are meant to emphasize the open-ended opportunities that 3D printing and low-power portable computing afford. They are not definitive instructions to be copied and pasted to obtain the same result, but instead should be considered as ideas to tinker with. To meet the expectations of stakeholders involved in a project, it will be necessary to read the room and get others involved in the making process, in ways that meet their needs and capabilities. The maker community is generally very friendly supportive; help is only a google search away.
<liclass="chapter" data-level="1.1" data-path="so-what-is-digital-archaeology.html"><ahref="so-what-is-digital-archaeology.html"><iclass="fa fa-check"></i><b>1.1</b> So what is Digital Archaeology?</a><ul>
138
138
<liclass="chapter" data-level="1.1.1" data-path="so-what-is-digital-archaeology.html"><ahref="so-what-is-digital-archaeology.html#a-distant-view"><iclass="fa fa-check"></i><b>1.1.1</b> A distant view</a></li>
139
139
<liclass="chapter" data-level="1.1.2" data-path="so-what-is-digital-archaeology.html"><ahref="so-what-is-digital-archaeology.html#is-digital-archaeology-part-of-the-digital-humanities"><iclass="fa fa-check"></i><b>1.1.2</b> Is digital archaeology part of the digital humanities?</a></li>
@@ -280,7 +280,6 @@
280
280
<liclass="chapter" data-level="4.2.2" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><ahref="d-printing-raspberry-pi-and-maker-archaeology.html#d-printing---a-workflow"><iclass="fa fa-check"></i><b>4.2.2</b> 3d Printing - a Workflow</a></li>
281
281
<liclass="chapter" data-level="4.2.3" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><ahref="d-printing-raspberry-pi-and-maker-archaeology.html#using-raspberry-pi-in-the-field"><iclass="fa fa-check"></i><b>4.2.3</b> Using Raspberry Pi in the Field</a></li>
<liclass="chapter" data-level="1.1" data-path="so-what-is-digital-archaeology.html"><ahref="so-what-is-digital-archaeology.html"><iclass="fa fa-check"></i><b>1.1</b> So what is Digital Archaeology?</a><ul>
138
138
<liclass="chapter" data-level="1.1.1" data-path="so-what-is-digital-archaeology.html"><ahref="so-what-is-digital-archaeology.html#a-distant-view"><iclass="fa fa-check"></i><b>1.1.1</b> A distant view</a></li>
139
139
<liclass="chapter" data-level="1.1.2" data-path="so-what-is-digital-archaeology.html"><ahref="so-what-is-digital-archaeology.html#is-digital-archaeology-part-of-the-digital-humanities"><iclass="fa fa-check"></i><b>1.1.2</b> Is digital archaeology part of the digital humanities?</a></li>
@@ -280,7 +280,6 @@
280
280
<liclass="chapter" data-level="4.2.2" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><ahref="d-printing-raspberry-pi-and-maker-archaeology.html#d-printing---a-workflow"><iclass="fa fa-check"></i><b>4.2.2</b> 3d Printing - a Workflow</a></li>
281
281
<liclass="chapter" data-level="4.2.3" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><ahref="d-printing-raspberry-pi-and-maker-archaeology.html#using-raspberry-pi-in-the-field"><iclass="fa fa-check"></i><b>4.2.3</b> Using Raspberry Pi in the Field</a></li>
0 commit comments