c++ - TBB parallelization of parsing with boots::spirit::qi -


In my program, I use Boost-Spirit-Qi to parse large data sets. Input data are sequential records. I am trying to use TBB to increase the efficiency of parsing. The process for parallel processing is as follows: 

  typed map map & lt; String, data_struct_t & gt; Mdata_t; Of vector & lt; String & gt; Text; Mdata_t data; Parallel_for (blocked_range & lt; size_t> (0, input.size (), GS), [& amp;] (blocked_range  & amp; r) {data_struct_t cs; mdata_t cr; string s ; For (size_t i = r.begin); I & lt; r.end (); i ++) {s = text [i]; Parser :: Job 1 (S, CS); Parse :: Task2 (S, CS); Parse :: Task 3 (S, CS); Parser :: Task 8 (S, CS); CRINSTART (CDTI, CS);} data. INSTECT (CRBBN (), CRand ())}, AP);

My program uses only 10% of CPU (2 CPUs, 16 cores) and works on 8 cores I do not understand why not use the remaining 8 cores Used (Single Processor)

Thanks for the advice.

your input.size () might be small or GS is too large to prevent the formation of adequate amounts of parallelism. Otherwise, if the number of threads is a matter of concern, then check the mask of your program's process, when you start it and how to start TBB (for example, if tbb :: task_scheduler_init threads made with fewer numbers).

For CPU usage, it is expected that your work is IO-bound, ie to read the file. It is also possible that the time required to complete a parallel repetition is very different from another repetition. In this case, small iterations can be completed before all the threads are ready. (When you want to accurately measure, you should wait manually when all threads are turned on)

Advice:

You have data.insert Because std :: map is not safe for concurrent modification. Use tbb :: concurrent_unordered_map or simply tbb :: parallel_readuce to merge partial results collected from cr to different codes.

pattern parser :: task 1 (s, cs); ... parser :: Task 8 (s, cs); can also be parallel if the work does not share the global state, see how the pipeline-type parallelism will be enabled for a series of these independent works.


Comments

Post a Comment

Popular posts from this blog

python - Overriding the save method in Django ModelForm -

I'm having trouble overriding a ModelForm save method. I get this error I'm: Exception type: TypeErier Exception Value: Save () found an unexpected keyword argument 'committed' My intentions include a form 3 fields Submit several values ​​for, then create an object for each combination of those areas, and to save each object file models.py class collarsult type (models.Model): id = model. AutoField (db_column = 'icontact_result_code_type_id', primary_key = true) callResult = models.ForeignKey ( 'CallResult', db_column = 'icontact_result_code_id') campaign = models.ForeignKey ( 'campaign', db_column = 'icampaign_id') CALLTYPE = models.ForeignKey ( 'CALLTYPE', db_column = 'icall_type_id') agent = models.BooleanField (db_column = 'bagent', default = true) teamLeader = models.BooleanField (db_column = 'bTeamLeader', default = true) active = models.BooleanField (db_column = Django.form...
Read more

html - CSS autoheight, but fit content to height of div -

I have a div in which there are three children- div in the left and middle div: float: left while true: float: true because it is my layout Actually will spoil, I've used ClearFix Hack: .cf {zoom: 1; }. Cf: First,. Cf: {content: ""; Display: Table; }. Cf: After {clear: both; } It still works, but I want to be the right div an indicator. So it should fill 100% of the parent unit of height. How can I complete this? PS is the full code: & Lt; / Div & gt; & Lt; Div class = "mobile_content" & gt; & Lt; H5 & gt; {{Data.titel}} & lt; / H5> & Lt; Table & gt; & Lt; TR & gt; & Lt; Th & gt; Komponist: & lt; / Th & gt; & Lt; TD & gt; {{Data.komponist}} & lt; / TD & gt; & Lt; / TR & gt; & Lt; TR & gt; & Lt; Th & gt; Instrument: & lt; / Th & gt; & Lt; TD & gt; {{Data.instrumente}} & lt; / TD & gt; & Lt; / TR & gt;...
Read more

qt - How to prevent QAudioInput from automatically boosting the master volume to 100%? -

I have been trying to use Qt5 multimedia to record audio with QAudioInput, however, when I see If QAudioInput is started, it increases the master volume of my sound device to 100%. How can I prevent QAudioInput from changing the master volume? My current development platform is Linux with PalsAdio (with flat audio disabled). How can I use QAudioInput : QAudioDeviceInfo device_info = QAudioDeviceInfo :: defaultInputDevice (); QAudio format format; Format.setSampleRate (44100); Format.setChannelCount (1); Format.setSampleSize (16); Format.setCodec ("Audio / PCM"); Format.setSampleType (QAudioFormat :: SignedInt); Format.setByteOrder (QAudioFormat :: LittleEndian); Std :: cout & lt; & Lt; Device_info.deviceName (). ToUtf8 (). ConstData () & lt; & Lt; Std :: endl; QAudioInput * default_device = new QAudioInput (device_info, format); QIODevice * default_io_device = default_device-> Start (); a QAudioInput.setVolume () method is not you I ...
Read more