Handling bid dist object

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Handling bid dist object

Aerenbkts bkts
I have a distance/dissimilarity matrix (30K rows 30K columns) that is
calculated in a loop and stored in ROM.

I would like to do clustering over the matrix.

I import and cluster it as below;

Mydata<-read.csv("Mydata.csv")
Mydata<-as.dist(Mydata)
Results<-hclust(Mydata)


But when I convert the matrix to dist object, I get RAM limitation error.
How can I handle it. Can I run hclust algorithm in a loop/chunking?

        [[alternative HTML version deleted]]

______________________________________________
[hidden email] mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.