parallel processing

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

parallel processing

Gambulator Gambulator
I did quite a bit of googling. it is not clear to me if it works now on
Windows or not. it is pretty slow even if I have turned off my
debug,verbose or print. any idea?

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Joshua Ulrich
On Mon, Oct 26, 2015 at 1:20 PM, Gambulator Gambulator
<[hidden email]> wrote:
> I did quite a bit of googling. it is not clear to me if it works now on
> Windows or not. it is pretty slow even if I have turned off my
> debug,verbose or print. any idea?
>
You need to be a lot more specific.  There are several parallel
processing methods that work on Windows.  And whether or not parallel
processing will be any faster than sequential processing depends on
the nature of the problem.

>         [[alternative HTML version deleted]]
>
^^^
Please do not post HTML, as it says in the posting guide.

> _______________________________________________
> [hidden email] mailing list
> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
> -- Subscriber-posting only. If you want to post, subscribe first.
> -- Also note that this is not the r-help list where general R questions should go.
^^^
Note that this question has nothing to do with finance, and should be on R-help.

--
Joshua Ulrich  |  about.me/joshuaulrich
FOSS Trading  |  www.fosstrading.com

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Bos, Roger-2
In reply to this post by Gambulator Gambulator
Not all of the parallel packages with in Windows, but doParallel is one that does.  Here is how to start it with 3 cores:

library(doParallel)
cl <- makeCluster(3)
registerDoParallel(cl)

It will automatically load the foreach package provided you have it installed.  Please see the documentation for foreach for examples.

Thanks,

Roger



***************************************************************
This message and any attachments are for the intended recipient's use only.
This message may contain confidential, proprietary or legally privileged
information. No right to confidential or privileged treatment
of this message is waived or lost by an error in transmission.
If you have received this message in error, please immediately
notify the sender by e-mail, delete the message, any attachments and all
copies from your system and destroy any hard copies.  You must
not, directly or indirectly, use, disclose, distribute,
print or copy any part of this message or any attachments if you are not
the intended recipient.


-----Original Message-----
From: R-SIG-Finance [mailto:[hidden email]] On Behalf Of Gambulator Gambulator
Sent: Monday, October 26, 2015 2:21 PM
To: [hidden email]
Subject: [R-SIG-Finance] parallel processing

I did quite a bit of googling. it is not clear to me if it works now on Windows or not. it is pretty slow even if I have turned off my debug,verbose or print. any idea?

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Gambulator Gambulator
thanks. I am running the optimization and yeah it is pretty slow so I
figure that I should put it on more cores. It seems/sounds like it 'd work
fine on Linux but now that you mention Windows, may be I will give it a
shot before firing up AWS and go through the pain to make an image and all
that.

thx

On Mon, Oct 26, 2015 at 11:28 AM, Bos, Roger <[hidden email]>
wrote:

> Not all of the parallel packages with in Windows, but doParallel is one
> that does.  Here is how to start it with 3 cores:
>
> library(doParallel)
> cl <- makeCluster(3)
> registerDoParallel(cl)
>
> It will automatically load the foreach package provided you have it
> installed.  Please see the documentation for foreach for examples.
>
> Thanks,
>
> Roger
>
>
>
> ***************************************************************
> This message and any attachments are for the intended recipient's use only.
> This message may contain confidential, proprietary or legally privileged
> information. No right to confidential or privileged treatment
> of this message is waived or lost by an error in transmission.
> If you have received this message in error, please immediately
> notify the sender by e-mail, delete the message, any attachments and all
> copies from your system and destroy any hard copies.  You must
> not, directly or indirectly, use, disclose, distribute,
> print or copy any part of this message or any attachments if you are not
> the intended recipient.
>
>
> -----Original Message-----
> From: R-SIG-Finance [mailto:[hidden email]] On
> Behalf Of Gambulator Gambulator
> Sent: Monday, October 26, 2015 2:21 PM
> To: [hidden email]
> Subject: [R-SIG-Finance] parallel processing
>
> I did quite a bit of googling. it is not clear to me if it works now on
> Windows or not. it is pretty slow even if I have turned off my
> debug,verbose or print. any idea?
>
>         [[alternative HTML version deleted]]
>
> _______________________________________________
> [hidden email] mailing list
> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
> -- Subscriber-posting only. If you want to post, subscribe first.
> -- Also note that this is not the r-help list where general R questions
> should go.
>

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Gambulator Gambulator
I tried to use the parallel core again and I get this error message. Note
that the non-parallel version works fine for me and I am using the
optimization feature.


This is how I call the parallel version:

if( Sys.info()['sysname'] == "Windows" )
{
  library(doParallel)
  cl=makeCluster(detectCores())
  registerDoParallel(cl)
  #registerDoSEQ()
} else {
  library(doMC)

  registerDoMC(cores=detectCores())
}

This is how I call the serial version:

if( Sys.info()['sysname'] == "Windows" )
{
  library(doParallel)

  registerDoSEQ()
} else {
  library(doMC)

  registerDoMC(cores=detectCores())
}

****************************error message for parallel below:

error calling combine function:
<simpleError in fun(result.1, result.2, result.3, result.4, result.5,
result.6,     result.7, result.8, result.9, result.10, result.11,
result.12,     result.13, result.14, result.15, result.16, result.17,
result.18,     result.19, result.20, result.21, result.22, result.23,
result.24,     result.25, result.26, result.27, result.28, result.29,
result.30,     result.31, result.32, result.33, result.34, result.35,
result.36,     result.37, result.38, result.39, result.40, result.41,
result.42,     result.43, result.44, result.45, result.46, result.47,
result.48,     result.49, result.50, result.51, result.52, result.53,
result.54,     result.55, result.56, result.57, result.58, result.59,
result.60,     result.61, result.62, result.63, result.64, result.65,
result.66,     result.67, result.68, result.69, result.70, result.71,
result.72,     result.73, result.74, result.75, result.76, result.77,
result.78,     result.79, result.80, result.81, result.82, result.83,
result.84,     result.85, result.86, result.87, result.88, result.89,
result.90,     result.91, result.92, result.93, result.94, result.95,
result.96,     result.97, result.98, result.99, result.100, result.101,
result.102, result.103, result.104, result.105, result.106,     result.107,
result.108, result.109, result.110, result.111,     result.112, result.113,
result.114, result.115, result.116,     result.117, result.118, result.119,
result.120, result.121,     result.122, result.123, result.124, result.125,
result.126,     result.127, result.128, result.129, result.130, result.131,
    result.132, result.133, result.134, result.135, result.136,
result.137, result.138, result.139, result.140, result.141,     result.142,
result.143, result.144, result.145, result.146,     result.147, result.148,
result.149, result.150, result.151,     result.152, result.153, result.154,
result.155, result.156,     result.157, result.158, result.159, result.160,
result.161,     result.162, result.163, result.164, result.165, result.166,
    result.167, result.168, result.169, result.170, result.171,
result.172, result.173, result.174, result.175, result.176,     result.177,
result.178, result.179, result.180, result.181,     result.182, result.183,
result.184, result.185, result.186,     result.187, result.188, result.189,
result.190, result.191,     result.192, result.193, result.194, result.195,
result.196,     result.197, result.198, result.199, result.200, result.201,
    result.202, result.203, result.204, result.205, result.206,
result.207, result.208, result.209, result.210, result.211,     result.212,
result.213, result.214, result.215, result.216,     result.217, result.218,
result.219, result.220, result.221,     result.222, result.223, result.224,
result.225, result.226,     result.227, result.228, result.229, result.230,
result.231,     result.232, result.233, result.234, result.235, result.236,
    result.237, result.238, result.239, result.240, result.241,
result.242, result.243, result.244, result.245, result.246,     result.247,
result.248, result.249, result.250, result.251,     result.252, result.253,
result.254, result.255, result.256,     result.257, result.258, result.259,
result.260, result.261,     result.262, result.263, result.264, result.265,
result.266,     result.267, result.268, result.269, result.270, result.271,
    result.272, result.273, result.274, result.275, result.276,
result.277, result.278, result.279, result.280, result.281,     result.282,
result.283, result.284, result.285, result.286,     result.287,
result.288): attempt to select less than one element>
>

On Mon, Oct 26, 2015 at 3:31 PM, Gambulator Gambulator <[hidden email]
> wrote:

> thanks. I am running the optimization and yeah it is pretty slow so I
> figure that I should put it on more cores. It seems/sounds like it 'd work
> fine on Linux but now that you mention Windows, may be I will give it a
> shot before firing up AWS and go through the pain to make an image and all
> that.
>
> thx
>
> On Mon, Oct 26, 2015 at 11:28 AM, Bos, Roger <[hidden email]>
> wrote:
>
>> Not all of the parallel packages with in Windows, but doParallel is one
>> that does.  Here is how to start it with 3 cores:
>>
>> library(doParallel)
>> cl <- makeCluster(3)
>> registerDoParallel(cl)
>>
>> It will automatically load the foreach package provided you have it
>> installed.  Please see the documentation for foreach for examples.
>>
>> Thanks,
>>
>> Roger
>>
>>
>>
>> ***************************************************************
>> This message and any attachments are for the intended recipient's use
>> only.
>> This message may contain confidential, proprietary or legally privileged
>> information. No right to confidential or privileged treatment
>> of this message is waived or lost by an error in transmission.
>> If you have received this message in error, please immediately
>> notify the sender by e-mail, delete the message, any attachments and all
>> copies from your system and destroy any hard copies.  You must
>> not, directly or indirectly, use, disclose, distribute,
>> print or copy any part of this message or any attachments if you are not
>> the intended recipient.
>>
>>
>> -----Original Message-----
>> From: R-SIG-Finance [mailto:[hidden email]] On
>> Behalf Of Gambulator Gambulator
>> Sent: Monday, October 26, 2015 2:21 PM
>> To: [hidden email]
>> Subject: [R-SIG-Finance] parallel processing
>>
>> I did quite a bit of googling. it is not clear to me if it works now on
>> Windows or not. it is pretty slow even if I have turned off my
>> debug,verbose or print. any idea?
>>
>>         [[alternative HTML version deleted]]
>>
>> _______________________________________________
>> [hidden email] mailing list
>> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>> -- Subscriber-posting only. If you want to post, subscribe first.
>> -- Also note that this is not the r-help list where general R questions
>> should go.
>>
>
>

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Erol Biceroglu-2
FYI, this gentleman has setup R studio AWS images for everyone to use.  So
there's no "pain" to set it up:

http://www.louisaslett.com/RStudio_AMI/



On Monday, October 26, 2015, Gambulator Gambulator <[hidden email]>
wrote:

> I tried to use the parallel core again and I get this error message. Note
> that the non-parallel version works fine for me and I am using the
> optimization feature.
>
>
> This is how I call the parallel version:
>
> if( Sys.info()['sysname'] == "Windows" )
> {
>   library(doParallel)
>   cl=makeCluster(detectCores())
>   registerDoParallel(cl)
>   #registerDoSEQ()
> } else {
>   library(doMC)
>
>   registerDoMC(cores=detectCores())
> }
>
> This is how I call the serial version:
>
> if( Sys.info()['sysname'] == "Windows" )
> {
>   library(doParallel)
>
>   registerDoSEQ()
> } else {
>   library(doMC)
>
>   registerDoMC(cores=detectCores())
> }
>
> ****************************error message for parallel below:
>
> error calling combine function:
> <simpleError in fun(result.1, result.2, result.3, result.4, result.5,
> result.6,     result.7, result.8, result.9, result.10, result.11,
> result.12,     result.13, result.14, result.15, result.16, result.17,
> result.18,     result.19, result.20, result.21, result.22, result.23,
> result.24,     result.25, result.26, result.27, result.28, result.29,
> result.30,     result.31, result.32, result.33, result.34, result.35,
> result.36,     result.37, result.38, result.39, result.40, result.41,
> result.42,     result.43, result.44, result.45, result.46, result.47,
> result.48,     result.49, result.50, result.51, result.52, result.53,
> result.54,     result.55, result.56, result.57, result.58, result.59,
> result.60,     result.61, result.62, result.63, result.64, result.65,
> result.66,     result.67, result.68, result.69, result.70, result.71,
> result.72,     result.73, result.74, result.75, result.76, result.77,
> result.78,     result.79, result.80, result.81, result.82, result.83,
> result.84,     result.85, result.86, result.87, result.88, result.89,
> result.90,     result.91, result.92, result.93, result.94, result.95,
> result.96,     result.97, result.98, result.99, result.100, result.101,
> result.102, result.103, result.104, result.105, result.106,     result.107,
> result.108, result.109, result.110, result.111,     result.112, result.113,
> result.114, result.115, result.116,     result.117, result.118, result.119,
> result.120, result.121,     result.122, result.123, result.124, result.125,
> result.126,     result.127, result.128, result.129, result.130, result.131,
>     result.132, result.133, result.134, result.135, result.136,
> result.137, result.138, result.139, result.140, result.141,     result.142,
> result.143, result.144, result.145, result.146,     result.147, result.148,
> result.149, result.150, result.151,     result.152, result.153, result.154,
> result.155, result.156,     result.157, result.158, result.159, result.160,
> result.161,     result.162, result.163, result.164, result.165, result.166,
>     result.167, result.168, result.169, result.170, result.171,
> result.172, result.173, result.174, result.175, result.176,     result.177,
> result.178, result.179, result.180, result.181,     result.182, result.183,
> result.184, result.185, result.186,     result.187, result.188, result.189,
> result.190, result.191,     result.192, result.193, result.194, result.195,
> result.196,     result.197, result.198, result.199, result.200, result.201,
>     result.202, result.203, result.204, result.205, result.206,
> result.207, result.208, result.209, result.210, result.211,     result.212,
> result.213, result.214, result.215, result.216,     result.217, result.218,
> result.219, result.220, result.221,     result.222, result.223, result.224,
> result.225, result.226,     result.227, result.228, result.229, result.230,
> result.231,     result.232, result.233, result.234, result.235, result.236,
>     result.237, result.238, result.239, result.240, result.241,
> result.242, result.243, result.244, result.245, result.246,     result.247,
> result.248, result.249, result.250, result.251,     result.252, result.253,
> result.254, result.255, result.256,     result.257, result.258, result.259,
> result.260, result.261,     result.262, result.263, result.264, result.265,
> result.266,     result.267, result.268, result.269, result.270, result.271,
>     result.272, result.273, result.274, result.275, result.276,
> result.277, result.278, result.279, result.280, result.281,     result.282,
> result.283, result.284, result.285, result.286,     result.287,
> result.288): attempt to select less than one element>
> >
>
> On Mon, Oct 26, 2015 at 3:31 PM, Gambulator Gambulator <
> [hidden email] <javascript:;>
> > wrote:
>
> > thanks. I am running the optimization and yeah it is pretty slow so I
> > figure that I should put it on more cores. It seems/sounds like it 'd
> work
> > fine on Linux but now that you mention Windows, may be I will give it a
> > shot before firing up AWS and go through the pain to make an image and
> all
> > that.
> >
> > thx
> >
> > On Mon, Oct 26, 2015 at 11:28 AM, Bos, Roger <[hidden email]
> <javascript:;>>
> > wrote:
> >
> >> Not all of the parallel packages with in Windows, but doParallel is one
> >> that does.  Here is how to start it with 3 cores:
> >>
> >> library(doParallel)
> >> cl <- makeCluster(3)
> >> registerDoParallel(cl)
> >>
> >> It will automatically load the foreach package provided you have it
> >> installed.  Please see the documentation for foreach for examples.
> >>
> >> Thanks,
> >>
> >> Roger
> >>
> >>
> >>
> >> ***************************************************************
> >> This message and any attachments are for the intended recipient's use
> >> only.
> >> This message may contain confidential, proprietary or legally privileged
> >> information. No right to confidential or privileged treatment
> >> of this message is waived or lost by an error in transmission.
> >> If you have received this message in error, please immediately
> >> notify the sender by e-mail, delete the message, any attachments and all
> >> copies from your system and destroy any hard copies.  You must
> >> not, directly or indirectly, use, disclose, distribute,
> >> print or copy any part of this message or any attachments if you are not
> >> the intended recipient.
> >>
> >>
> >> -----Original Message-----
> >> From: R-SIG-Finance [mailto:[hidden email]
> <javascript:;>] On
> >> Behalf Of Gambulator Gambulator
> >> Sent: Monday, October 26, 2015 2:21 PM
> >> To: [hidden email] <javascript:;>
> >> Subject: [R-SIG-Finance] parallel processing
> >>
> >> I did quite a bit of googling. it is not clear to me if it works now on
> >> Windows or not. it is pretty slow even if I have turned off my
> >> debug,verbose or print. any idea?
> >>
> >>         [[alternative HTML version deleted]]
> >>
> >> _______________________________________________
> >> [hidden email] <javascript:;> mailing list
> >> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
> >> -- Subscriber-posting only. If you want to post, subscribe first.
> >> -- Also note that this is not the r-help list where general R questions
> >> should go.
> >>
> >
> >
>
>         [[alternative HTML version deleted]]
>
> _______________________________________________
> [hidden email] <javascript:;> mailing list
> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
> -- Subscriber-posting only. If you want to post, subscribe first.
> -- Also note that this is not the r-help list where general R questions
> should go.
>


--

Erol Biceroglu


*[hidden email]
<[hidden email]>416-275-7970*

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Gambulator Gambulator
thanks. I was trying this last night and I think R just released 3.2.2 and
nothing seems to be compatible with it... I gave up last night.... but now
that you showed me this post, I am going to try it again.

thanks

On Tue, Oct 27, 2015 at 5:26 AM, Erol Biceroglu <
[hidden email]> wrote:

> FYI, this gentleman has setup R studio AWS images for everyone to use.  So
> there's no "pain" to set it up:
>
> http://www.louisaslett.com/RStudio_AMI/
>
>
>
> On Monday, October 26, 2015, Gambulator Gambulator <[hidden email]>
> wrote:
>
>> I tried to use the parallel core again and I get this error message. Note
>> that the non-parallel version works fine for me and I am using the
>> optimization feature.
>>
>>
>> This is how I call the parallel version:
>>
>> if( Sys.info()['sysname'] == "Windows" )
>> {
>>   library(doParallel)
>>   cl=makeCluster(detectCores())
>>   registerDoParallel(cl)
>>   #registerDoSEQ()
>> } else {
>>   library(doMC)
>>
>>   registerDoMC(cores=detectCores())
>> }
>>
>> This is how I call the serial version:
>>
>> if( Sys.info()['sysname'] == "Windows" )
>> {
>>   library(doParallel)
>>
>>   registerDoSEQ()
>> } else {
>>   library(doMC)
>>
>>   registerDoMC(cores=detectCores())
>> }
>>
>> ****************************error message for parallel below:
>>
>> error calling combine function:
>> <simpleError in fun(result.1, result.2, result.3, result.4, result.5,
>> result.6,     result.7, result.8, result.9, result.10, result.11,
>> result.12,     result.13, result.14, result.15, result.16, result.17,
>> result.18,     result.19, result.20, result.21, result.22, result.23,
>> result.24,     result.25, result.26, result.27, result.28, result.29,
>> result.30,     result.31, result.32, result.33, result.34, result.35,
>> result.36,     result.37, result.38, result.39, result.40, result.41,
>> result.42,     result.43, result.44, result.45, result.46, result.47,
>> result.48,     result.49, result.50, result.51, result.52, result.53,
>> result.54,     result.55, result.56, result.57, result.58, result.59,
>> result.60,     result.61, result.62, result.63, result.64, result.65,
>> result.66,     result.67, result.68, result.69, result.70, result.71,
>> result.72,     result.73, result.74, result.75, result.76, result.77,
>> result.78,     result.79, result.80, result.81, result.82, result.83,
>> result.84,     result.85, result.86, result.87, result.88, result.89,
>> result.90,     result.91, result.92, result.93, result.94, result.95,
>> result.96,     result.97, result.98, result.99, result.100, result.101,
>> result.102, result.103, result.104, result.105, result.106,
>>  result.107,
>> result.108, result.109, result.110, result.111,     result.112,
>> result.113,
>> result.114, result.115, result.116,     result.117, result.118,
>> result.119,
>> result.120, result.121,     result.122, result.123, result.124,
>> result.125,
>> result.126,     result.127, result.128, result.129, result.130,
>> result.131,
>>     result.132, result.133, result.134, result.135, result.136,
>> result.137, result.138, result.139, result.140, result.141,
>>  result.142,
>> result.143, result.144, result.145, result.146,     result.147,
>> result.148,
>> result.149, result.150, result.151,     result.152, result.153,
>> result.154,
>> result.155, result.156,     result.157, result.158, result.159,
>> result.160,
>> result.161,     result.162, result.163, result.164, result.165,
>> result.166,
>>     result.167, result.168, result.169, result.170, result.171,
>> result.172, result.173, result.174, result.175, result.176,
>>  result.177,
>> result.178, result.179, result.180, result.181,     result.182,
>> result.183,
>> result.184, result.185, result.186,     result.187, result.188,
>> result.189,
>> result.190, result.191,     result.192, result.193, result.194,
>> result.195,
>> result.196,     result.197, result.198, result.199, result.200,
>> result.201,
>>     result.202, result.203, result.204, result.205, result.206,
>> result.207, result.208, result.209, result.210, result.211,
>>  result.212,
>> result.213, result.214, result.215, result.216,     result.217,
>> result.218,
>> result.219, result.220, result.221,     result.222, result.223,
>> result.224,
>> result.225, result.226,     result.227, result.228, result.229,
>> result.230,
>> result.231,     result.232, result.233, result.234, result.235,
>> result.236,
>>     result.237, result.238, result.239, result.240, result.241,
>> result.242, result.243, result.244, result.245, result.246,
>>  result.247,
>> result.248, result.249, result.250, result.251,     result.252,
>> result.253,
>> result.254, result.255, result.256,     result.257, result.258,
>> result.259,
>> result.260, result.261,     result.262, result.263, result.264,
>> result.265,
>> result.266,     result.267, result.268, result.269, result.270,
>> result.271,
>>     result.272, result.273, result.274, result.275, result.276,
>> result.277, result.278, result.279, result.280, result.281,
>>  result.282,
>> result.283, result.284, result.285, result.286,     result.287,
>> result.288): attempt to select less than one element>
>> >
>>
>> On Mon, Oct 26, 2015 at 3:31 PM, Gambulator Gambulator <
>> [hidden email]
>> > wrote:
>>
>> > thanks. I am running the optimization and yeah it is pretty slow so I
>> > figure that I should put it on more cores. It seems/sounds like it 'd
>> work
>> > fine on Linux but now that you mention Windows, may be I will give it a
>> > shot before firing up AWS and go through the pain to make an image and
>> all
>> > that.
>> >
>> > thx
>> >
>> > On Mon, Oct 26, 2015 at 11:28 AM, Bos, Roger <[hidden email]>
>> > wrote:
>> >
>> >> Not all of the parallel packages with in Windows, but doParallel is one
>> >> that does.  Here is how to start it with 3 cores:
>> >>
>> >> library(doParallel)
>> >> cl <- makeCluster(3)
>> >> registerDoParallel(cl)
>> >>
>> >> It will automatically load the foreach package provided you have it
>> >> installed.  Please see the documentation for foreach for examples.
>> >>
>> >> Thanks,
>> >>
>> >> Roger
>> >>
>> >>
>> >>
>> >> ***************************************************************
>> >> This message and any attachments are for the intended recipient's use
>> >> only.
>> >> This message may contain confidential, proprietary or legally
>> privileged
>> >> information. No right to confidential or privileged treatment
>> >> of this message is waived or lost by an error in transmission.
>> >> If you have received this message in error, please immediately
>> >> notify the sender by e-mail, delete the message, any attachments and
>> all
>> >> copies from your system and destroy any hard copies.  You must
>> >> not, directly or indirectly, use, disclose, distribute,
>> >> print or copy any part of this message or any attachments if you are
>> not
>> >> the intended recipient.
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: R-SIG-Finance [mailto:[hidden email]] On
>> >> Behalf Of Gambulator Gambulator
>> >> Sent: Monday, October 26, 2015 2:21 PM
>> >> To: [hidden email]
>> >> Subject: [R-SIG-Finance] parallel processing
>> >>
>> >> I did quite a bit of googling. it is not clear to me if it works now on
>> >> Windows or not. it is pretty slow even if I have turned off my
>> >> debug,verbose or print. any idea?
>> >>
>> >>         [[alternative HTML version deleted]]
>> >>
>> >> _______________________________________________
>> >> [hidden email] mailing list
>> >> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>> >> -- Subscriber-posting only. If you want to post, subscribe first.
>> >> -- Also note that this is not the r-help list where general R questions
>> >> should go.
>> >>
>> >
>> >
>>
>>         [[alternative HTML version deleted]]
>>
>> _______________________________________________
>> [hidden email] mailing list
>> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>> -- Subscriber-posting only. If you want to post, subscribe first.
>> -- Also note that this is not the r-help list where general R questions
>> should go.
>>
>
>
> --
>
> Erol Biceroglu
>
>
> *[hidden email]
> <[hidden email]>416-275-7970 <416-275-7970>*
>

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.
Reply | Threaded
Open this post in threaded view
|

Re: parallel processing

Gambulator Gambulator
I used the AMI image and kickoff the parallel processing. It works well.
Thanks everyone  for your help

On Tue, Oct 27, 2015 at 7:28 AM, Gambulator Gambulator <[hidden email]
> wrote:

> thanks. I was trying this last night and I think R just released 3.2.2 and
> nothing seems to be compatible with it... I gave up last night.... but now
> that you showed me this post, I am going to try it again.
>
> thanks
>
> On Tue, Oct 27, 2015 at 5:26 AM, Erol Biceroglu <
> [hidden email]> wrote:
>
>> FYI, this gentleman has setup R studio AWS images for everyone to use.
>> So there's no "pain" to set it up:
>>
>> http://www.louisaslett.com/RStudio_AMI/
>>
>>
>>
>> On Monday, October 26, 2015, Gambulator Gambulator <[hidden email]>
>> wrote:
>>
>>> I tried to use the parallel core again and I get this error message. Note
>>> that the non-parallel version works fine for me and I am using the
>>> optimization feature.
>>>
>>>
>>> This is how I call the parallel version:
>>>
>>> if( Sys.info()['sysname'] == "Windows" )
>>> {
>>>   library(doParallel)
>>>   cl=makeCluster(detectCores())
>>>   registerDoParallel(cl)
>>>   #registerDoSEQ()
>>> } else {
>>>   library(doMC)
>>>
>>>   registerDoMC(cores=detectCores())
>>> }
>>>
>>> This is how I call the serial version:
>>>
>>> if( Sys.info()['sysname'] == "Windows" )
>>> {
>>>   library(doParallel)
>>>
>>>   registerDoSEQ()
>>> } else {
>>>   library(doMC)
>>>
>>>   registerDoMC(cores=detectCores())
>>> }
>>>
>>> ****************************error message for parallel below:
>>>
>>> error calling combine function:
>>> <simpleError in fun(result.1, result.2, result.3, result.4, result.5,
>>> result.6,     result.7, result.8, result.9, result.10, result.11,
>>> result.12,     result.13, result.14, result.15, result.16, result.17,
>>> result.18,     result.19, result.20, result.21, result.22, result.23,
>>> result.24,     result.25, result.26, result.27, result.28, result.29,
>>> result.30,     result.31, result.32, result.33, result.34, result.35,
>>> result.36,     result.37, result.38, result.39, result.40, result.41,
>>> result.42,     result.43, result.44, result.45, result.46, result.47,
>>> result.48,     result.49, result.50, result.51, result.52, result.53,
>>> result.54,     result.55, result.56, result.57, result.58, result.59,
>>> result.60,     result.61, result.62, result.63, result.64, result.65,
>>> result.66,     result.67, result.68, result.69, result.70, result.71,
>>> result.72,     result.73, result.74, result.75, result.76, result.77,
>>> result.78,     result.79, result.80, result.81, result.82, result.83,
>>> result.84,     result.85, result.86, result.87, result.88, result.89,
>>> result.90,     result.91, result.92, result.93, result.94, result.95,
>>> result.96,     result.97, result.98, result.99, result.100, result.101,
>>> result.102, result.103, result.104, result.105, result.106,
>>>  result.107,
>>> result.108, result.109, result.110, result.111,     result.112,
>>> result.113,
>>> result.114, result.115, result.116,     result.117, result.118,
>>> result.119,
>>> result.120, result.121,     result.122, result.123, result.124,
>>> result.125,
>>> result.126,     result.127, result.128, result.129, result.130,
>>> result.131,
>>>     result.132, result.133, result.134, result.135, result.136,
>>> result.137, result.138, result.139, result.140, result.141,
>>>  result.142,
>>> result.143, result.144, result.145, result.146,     result.147,
>>> result.148,
>>> result.149, result.150, result.151,     result.152, result.153,
>>> result.154,
>>> result.155, result.156,     result.157, result.158, result.159,
>>> result.160,
>>> result.161,     result.162, result.163, result.164, result.165,
>>> result.166,
>>>     result.167, result.168, result.169, result.170, result.171,
>>> result.172, result.173, result.174, result.175, result.176,
>>>  result.177,
>>> result.178, result.179, result.180, result.181,     result.182,
>>> result.183,
>>> result.184, result.185, result.186,     result.187, result.188,
>>> result.189,
>>> result.190, result.191,     result.192, result.193, result.194,
>>> result.195,
>>> result.196,     result.197, result.198, result.199, result.200,
>>> result.201,
>>>     result.202, result.203, result.204, result.205, result.206,
>>> result.207, result.208, result.209, result.210, result.211,
>>>  result.212,
>>> result.213, result.214, result.215, result.216,     result.217,
>>> result.218,
>>> result.219, result.220, result.221,     result.222, result.223,
>>> result.224,
>>> result.225, result.226,     result.227, result.228, result.229,
>>> result.230,
>>> result.231,     result.232, result.233, result.234, result.235,
>>> result.236,
>>>     result.237, result.238, result.239, result.240, result.241,
>>> result.242, result.243, result.244, result.245, result.246,
>>>  result.247,
>>> result.248, result.249, result.250, result.251,     result.252,
>>> result.253,
>>> result.254, result.255, result.256,     result.257, result.258,
>>> result.259,
>>> result.260, result.261,     result.262, result.263, result.264,
>>> result.265,
>>> result.266,     result.267, result.268, result.269, result.270,
>>> result.271,
>>>     result.272, result.273, result.274, result.275, result.276,
>>> result.277, result.278, result.279, result.280, result.281,
>>>  result.282,
>>> result.283, result.284, result.285, result.286,     result.287,
>>> result.288): attempt to select less than one element>
>>> >
>>>
>>> On Mon, Oct 26, 2015 at 3:31 PM, Gambulator Gambulator <
>>> [hidden email]
>>> > wrote:
>>>
>>> > thanks. I am running the optimization and yeah it is pretty slow so I
>>> > figure that I should put it on more cores. It seems/sounds like it 'd
>>> work
>>> > fine on Linux but now that you mention Windows, may be I will give it a
>>> > shot before firing up AWS and go through the pain to make an image and
>>> all
>>> > that.
>>> >
>>> > thx
>>> >
>>> > On Mon, Oct 26, 2015 at 11:28 AM, Bos, Roger <[hidden email]
>>> >
>>> > wrote:
>>> >
>>> >> Not all of the parallel packages with in Windows, but doParallel is
>>> one
>>> >> that does.  Here is how to start it with 3 cores:
>>> >>
>>> >> library(doParallel)
>>> >> cl <- makeCluster(3)
>>> >> registerDoParallel(cl)
>>> >>
>>> >> It will automatically load the foreach package provided you have it
>>> >> installed.  Please see the documentation for foreach for examples.
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Roger
>>> >>
>>> >>
>>> >>
>>> >> ***************************************************************
>>> >> This message and any attachments are for the intended recipient's use
>>> >> only.
>>> >> This message may contain confidential, proprietary or legally
>>> privileged
>>> >> information. No right to confidential or privileged treatment
>>> >> of this message is waived or lost by an error in transmission.
>>> >> If you have received this message in error, please immediately
>>> >> notify the sender by e-mail, delete the message, any attachments and
>>> all
>>> >> copies from your system and destroy any hard copies.  You must
>>> >> not, directly or indirectly, use, disclose, distribute,
>>> >> print or copy any part of this message or any attachments if you are
>>> not
>>> >> the intended recipient.
>>> >>
>>> >>
>>> >> -----Original Message-----
>>> >> From: R-SIG-Finance [mailto:[hidden email]] On
>>> >> Behalf Of Gambulator Gambulator
>>> >> Sent: Monday, October 26, 2015 2:21 PM
>>> >> To: [hidden email]
>>> >> Subject: [R-SIG-Finance] parallel processing
>>> >>
>>> >> I did quite a bit of googling. it is not clear to me if it works now
>>> on
>>> >> Windows or not. it is pretty slow even if I have turned off my
>>> >> debug,verbose or print. any idea?
>>> >>
>>> >>         [[alternative HTML version deleted]]
>>> >>
>>> >> _______________________________________________
>>> >> [hidden email] mailing list
>>> >> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>>> >> -- Subscriber-posting only. If you want to post, subscribe first.
>>> >> -- Also note that this is not the r-help list where general R
>>> questions
>>> >> should go.
>>> >>
>>> >
>>> >
>>>
>>>         [[alternative HTML version deleted]]
>>>
>>> _______________________________________________
>>> [hidden email] mailing list
>>> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>>> -- Subscriber-posting only. If you want to post, subscribe first.
>>> -- Also note that this is not the r-help list where general R questions
>>> should go.
>>>
>>
>>
>> --
>>
>> Erol Biceroglu
>>
>>
>> *[hidden email]
>> <[hidden email]>416-275-7970 <416-275-7970>*
>>
>
>

        [[alternative HTML version deleted]]

_______________________________________________
[hidden email] mailing list
https://stat.ethz.ch/mailman/listinfo/r-sig-finance
-- Subscriber-posting only. If you want to post, subscribe first.
-- Also note that this is not the r-help list where general R questions should go.