let's say, for example, i have this data:
data <- c(1,2,3,4,5,6,NaN,5,9,NaN,23,9)
attr(data,"dim") <- c(6,2)
data
[,1] [,2]
[1,] 1 NaN
[2,] 2 5
[3,] 3 9
[4,] 4 NaN
[5,] 5 23
[6,] 6 9
Now i want to remove the rows with the NaN values in it: row 1 and 4.
But i don't know where these rows are, if it's a dataset of 100.000+ rows, so i need to find them with a function and remove the complete row.
Can anybody point me in the right direction?
The function complete.cases
will tell you where the rows are that you need:
data <- matrix(c(1,2,3,4,5,6,NaN,5,9,NaN,23,9), ncol=2)
data[complete.cases(data), ]
[,1] [,2]
[1,] 2 5
[2,] 3 9
[3,] 5 23
[4,] 6 9
DATA
data <- matrix(rnorm(100000000), ncol=10000)
idx <- sample(1:10000,100)
idy <- sample(1:10000,100)
data[idx,idy] <- NaN
FUNCTION
foo <- function(d=data) d[apply(d,2,function(x) any(is.nan(x))),]
RUNTIMES
> system.time(data[complete.cases(data),])
user system elapsed
3.53 0.12 3.65
> system.time(foo(data))
user system elapsed
2.37 0.09 2.46